![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4678 originally caused by: Started by upstream project "master-osmo-trx" build number 4882 originally caused by: Started by upstream project "master-libusrp" build number 1825 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17660 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6681 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8947 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2957 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29271 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5152 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30049 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4678 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12971 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9242 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins13284858171719054197.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 15:36:56 + trial_dir_prefix=trial- + rm -rf trial-2375 trial-2375-bin.tgz trial-2375-run.tgz + trial_dir=trial-2376 + mkdir -p trial-2376 + mv open5gs.build-8.tgz osmo-bsc.build-17660.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6681.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2957.tgz osmo-mgw.build-8947.tgz osmo-msc.build-29271.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30049.tgz osmo-stp.build-9242.tgz osmo-trx.build-4678.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz trial-2376 + cat open5gs.build-8.md5 osmo-bsc.build-17660.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6681.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2957.md5 osmo-mgw.build-8947.md5 osmo-msc.build-29271.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30049.md5 osmo-stp.build-9242.md5 osmo-trx.build-4678.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17660.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6681.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2957.md5 osmo-mgw.build-8947.md5 osmo-msc.build-29271.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30049.md5 osmo-stp.build-9242.md5 osmo-trx.build-4678.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2376 combinations: None trial: 'trial-2376' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2376 -------------------------------------------------------------------------------------------- 15:37:08.160085 tst trial-2376: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/log --------------------------------------------------------------------- trial-2376 nitb_sms:sysmo --------------------------------------------------------------------- 15:39:18.403064 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:39:18.406959 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 15:39:18.428618 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 15:39:18.437073 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 15:39:18.491042 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 15:39:18.512521 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 15:39:18.519870 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 15:39:19.059161 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 15:39:19.064277 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 15:39:19.075593 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 15:39:19.467722 tst mo_mt_sms.py: using LAC 28940 15:39:19.714824 tst mo_mt_sms.py: using RAC 125 15:39:19.839747 tst mo_mt_sms.py: using CellId 28940 15:39:19.962870 tst mo_mt_sms.py: using BVCI 28941 15:39:20.076755 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 15:39:20.260225 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 15:39:20.378796 tst mo_mt_sms.py:9: start nitb and bts... 15:39:20.597166 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:39:22.948308 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19656): Launched 15:39:23.275021 run osmo-nitb_10.42.42.2(pid=19657): Launched 15:39:23.452226 run osmo-nitb_10.42.42.2(pid=19657): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19657)] 15:39:23.585173 run osmo-nitb_10.42.42.2(pid=19657): stdout: | (launched: 2022-12-10_15:39:23.214337) 15:39:23.719972 run osmo-nitb_10.42.42.2(pid=19657): stderr: | (launched: 2022-12-10_15:39:23.262683) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:39:23.854482 run osmo-nitb_10.42.42.2(pid=19657): stdout: | (launched: 2022-12-10_15:39:23.214337) 15:39:23.983220 run osmo-nitb_10.42.42.2(pid=19657): stderr: | (launched: 2022-12-10_15:39:23.262683) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:39:24.137761 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19657): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19657) [trial-2376↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19657)] [trial-2376↪nitb_sms:sysmo↪mo_mt_sms.py:11] 15:39:24.146752 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 15:39:24.153891 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19656): Terminating (SIGTERM) 15:39:24.365708 --- ParallelTerminationStrategy: PID 19656 died... 15:39:24.387690 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19656): Terminated: ok {rc=0} 15:39:24.478241 bus /sierra_3: Setting Powered False 15:39:25.579078 bus /sierra_3: Setting Powered False 15:39:26.698284 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 sms:sysmo --------------------------------------------------------------------- 15:39:27.884273 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:39:27.888846 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 15:39:27.911219 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 15:39:27.940587 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 15:39:27.996336 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 15:39:28.017890 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 15:39:28.045581 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 15:39:28.593073 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 sms:sysmo mo_mt_sms.py ---------------------------------------------- 15:39:28.598243 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:28.609419 tst sms:sysmo: Using 1 x bts (candidates: 1) 15:39:28.645157 tst mo_mt_sms.py: using LAC 28941 15:39:28.771899 tst mo_mt_sms.py: using RAC 126 15:39:28.897568 tst mo_mt_sms.py: using CellId 28941 15:39:29.020690 tst mo_mt_sms.py: using BVCI 28942 15:39:29.131406 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:29.142143 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:29.152688 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:29.163335 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:29.174018 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:29.184335 tst sms:sysmo: Using 1 x modem (candidates: 2) 15:39:29.300573 tst sms:sysmo: Using 1 x modem (candidates: 2) 15:39:29.421426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:31.159663 run create_hlr_db(pid=19663): Launched 15:39:31.311915 bus /sierra_2: Setting Powered False 15:39:32.370823 run create_hlr_db(pid=19663): Terminated: ok {rc=0} 15:39:32.819224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19665): Launched 15:39:33.146553 run osmo-hlr_10.42.42.2(pid=19666): Launched 15:39:33.273238 run osmo-stp_10.42.42.5: Starting osmo-stp 15:39:35.860294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19668): Launched 15:39:36.188141 run osmo-stp_10.42.42.5(pid=19669): Launched 15:39:36.313812 run osmo-msc_10.42.42.6: Starting osmo-msc 15:39:41.787757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19671): Launched 15:39:42.116059 run osmo-msc_10.42.42.6(pid=19672): Launched 15:39:42.296843 run osmo-stp_10.42.42.5(pid=19669): ERR: Terminated: ERROR {rc=1} [trial-2376↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19669)] 15:39:42.433206 run osmo-stp_10.42.42.5(pid=19669): stdout: | (launched: 2022-12-10_15:39:36.127247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:42.570495 run osmo-stp_10.42.42.5(pid=19669): stderr: | [0;m[38;5;43m20221210153936328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210153936328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210153936328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210153936329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210153936329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210153936329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210153936329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:42.707293 run osmo-stp_10.42.42.5(pid=19669): stdout: | (launched: 2022-12-10_15:39:36.127247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:42.836580 run osmo-stp_10.42.42.5(pid=19669): stderr: | [0;m[38;5;43m20221210153936328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210153936328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210153936328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210153936329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210153936329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210153936329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210153936329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:42.991511 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19669): Process ended prematurely: osmo-stp_10.42.42.5(pid=19669) [trial-2376↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19669)] [trial-2376↪sms:sysmo↪mo_mt_sms.py:16] 15:39:43.000420 tst mo_mt_sms.py:16: Test FAILED (14.4 sec) 15:39:43.028741 run osmo-hlr_10.42.42.2(pid=19666): ERR: Terminated: ERROR {rc=237} [trial-2376↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19666)] 15:39:43.079894 run osmo-hlr_10.42.42.2(pid=19666): stdout: | (launched: 2022-12-10_15:39:33.085440) 15:39:43.132574 run osmo-hlr_10.42.42.2(pid=19666): stderr: | [0;m[1;31m20221210153933287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210153933287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210153933287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210153933287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210153933287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210153933287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210153933300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210153933308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210153933308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210153933308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:39:43.205786 run osmo-msc_10.42.42.6(pid=19672): ERR: Terminated: ERROR {rc=2} [trial-2376↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19672)] 15:39:43.256627 run osmo-msc_10.42.42.6(pid=19672): stdout: | (launched: 2022-12-10_15:39:42.054899) 15:39:43.314844 run osmo-msc_10.42.42.6(pid=19672): stderr: | [0;m[38;5;43m20221210153942384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210153942384 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbe7e4bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210153942384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210153942384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210153942384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210153942384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210153942386 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210153942387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210153942387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210153942387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:39:43.377768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19665): Terminating (SIGTERM) 15:39:43.420462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19668): Terminating (SIGTERM) 15:39:43.463236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19671): Terminating (SIGTERM) 15:39:43.506039 --- ParallelTerminationStrategy: PID 19665 died... 15:39:43.526357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19665): Terminated: ok {rc=0} 15:39:43.574014 --- ParallelTerminationStrategy: PID 19668 died... 15:39:43.593960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19668): Terminated: ok {rc=0} 15:39:43.641369 --- ParallelTerminationStrategy: PID 19671 died... 15:39:43.661445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19671): Terminated: ok {rc=0} 15:39:43.750282 bus /sierra_3: Setting Powered False 15:39:44.851953 bus /sierra_3: Setting Powered False 15:39:45.980073 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_ussd:sysmo --------------------------------------------------------------------- 15:39:47.240406 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:39:47.245224 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 15:39:47.269903 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 15:39:47.278652 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 15:39:47.316044 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 15:39:47.337683 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 15:39:47.344902 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 15:39:47.865259 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2376 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 15:39:47.870709 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 15:39:47.882243 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 15:39:47.919179 tst assert_extension.py: using LAC 28942 15:39:48.051528 tst assert_extension.py: using RAC 127 15:39:48.178950 tst assert_extension.py: using CellId 28942 15:39:48.304258 tst assert_extension.py: using BVCI 28943 15:39:48.431642 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 15:39:48.557847 tst assert_extension.py:10: start nitb and bts... 15:39:48.766221 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:39:49.391571 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19677): Launched 15:39:49.698600 run osmo-nitb_10.42.42.2(pid=19678): Launched 15:39:49.868127 run osmo-nitb_10.42.42.2(pid=19678): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19678)] 15:39:50.003999 run osmo-nitb_10.42.42.2(pid=19678): stdout: | (launched: 2022-12-10_15:39:49.640462) 15:39:50.141609 run osmo-nitb_10.42.42.2(pid=19678): stderr: | (launched: 2022-12-10_15:39:49.686014) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:39:50.279157 run osmo-nitb_10.42.42.2(pid=19678): stdout: | (launched: 2022-12-10_15:39:49.640462) 15:39:50.411798 run osmo-nitb_10.42.42.2(pid=19678): stderr: | (launched: 2022-12-10_15:39:49.686014) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19678): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19678) [trial-2376↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19678)] 15:39:50.815128 tst osmo-nitb_10.42.42.2(pid=19678): stdout: | (launched: 2022-12-10_15:39:49.640462) 15:39:50.938878 tst osmo-nitb_10.42.42.2(pid=19678): stderr: | (launched: 2022-12-10_15:39:49.686014) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:39:51.084287 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19678): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19678) [trial-2376↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19678)] [trial-2376↪nitb_ussd:sysmo↪assert_extension.py:12] 15:39:51.092821 tst assert_extension.py:12: Test FAILED (3.2 sec) 15:39:51.099665 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19677): Terminating (SIGTERM) 15:39:51.308816 --- ParallelTerminationStrategy: PID 19677 died... 15:39:51.329469 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19677): Terminated: ok {rc=0} 15:39:51.416084 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 ussd:sysmo --------------------------------------------------------------------- 15:39:52.620200 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:39:52.625505 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 15:39:52.649155 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 15:39:52.677561 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 15:39:52.713441 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 15:39:52.734587 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 15:39:52.762712 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 15:39:53.292136 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 ussd:sysmo assert_extension.py ---------------------------------------------- 15:39:53.298436 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:53.310172 tst ussd:sysmo: Using 1 x bts (candidates: 1) 15:39:53.346953 tst assert_extension.py: using LAC 28943 15:39:53.473084 tst assert_extension.py: using RAC 128 15:39:53.598917 tst assert_extension.py: using CellId 28943 15:39:53.724588 tst assert_extension.py: using BVCI 28944 15:39:53.842764 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:53.853950 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:53.864858 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:53.876058 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:53.887106 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:53.898203 tst ussd:sysmo: Using 1 x modem (candidates: 1) 15:39:54.012717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:54.522020 run create_hlr_db(pid=19682): Launched 15:39:54.653516 bus /sierra_2: Setting Powered False 15:39:55.718237 run create_hlr_db(pid=19682): Terminated: ok {rc=0} 15:39:56.173077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19684): Launched 15:39:56.501617 run osmo-hlr_10.42.42.2(pid=19685): Launched 15:39:56.627207 run osmo-stp_10.42.42.5: Starting osmo-stp 15:39:57.190204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19687): Launched 15:39:57.518375 run osmo-stp_10.42.42.5(pid=19688): Launched 15:39:57.641801 run osmo-msc_10.42.42.6: Starting osmo-msc 15:39:58.233961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19690): Launched 15:39:58.563145 run osmo-msc_10.42.42.6(pid=19691): Launched 15:39:58.746343 run osmo-stp_10.42.42.5(pid=19688): ERR: Terminated: ERROR {rc=1} [trial-2376↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19688)] 15:39:58.882937 run osmo-stp_10.42.42.5(pid=19688): stdout: | (launched: 2022-12-10_15:39:57.457154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:59.020133 run osmo-stp_10.42.42.5(pid=19688): stderr: | [0;m[38;5;43m20221210153957652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210153957652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210153957652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210153957653 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210153957655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210153957655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210153957655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:59.156361 run osmo-stp_10.42.42.5(pid=19688): stdout: | (launched: 2022-12-10_15:39:57.457154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:59.286142 run osmo-stp_10.42.42.5(pid=19688): stderr: | [0;m[38;5;43m20221210153957652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210153957652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210153957652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210153957653 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210153957655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210153957655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210153957655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:59.441048 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19688): Process ended prematurely: osmo-stp_10.42.42.5(pid=19688) [trial-2376↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19688)] [trial-2376↪ussd:sysmo↪assert_extension.py:17] 15:39:59.450077 tst assert_extension.py:17: Test FAILED (6.1 sec) 15:39:59.477662 run osmo-hlr_10.42.42.2(pid=19685): ERR: Terminated: ERROR {rc=237} [trial-2376↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19685)] 15:39:59.528403 run osmo-hlr_10.42.42.2(pid=19685): stdout: | (launched: 2022-12-10_15:39:56.440289) 15:39:59.580910 run osmo-hlr_10.42.42.2(pid=19685): stderr: | [0;m[1;31m20221210153956643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210153956643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210153956643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210153956643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210153956643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210153956643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210153956682 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210153956692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210153956693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210153956693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:39:59.653876 run osmo-msc_10.42.42.6(pid=19691): ERR: Terminated: ERROR {rc=2} [trial-2376↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19691)] 15:39:59.705139 run osmo-msc_10.42.42.6(pid=19691): stdout: | (launched: 2022-12-10_15:39:58.501867) 15:39:59.757549 run osmo-msc_10.42.42.6(pid=19691): stderr: | [0;m[38;5;43m20221210153958829 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210153958829 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1804ab6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210153958829 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210153958829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210153958829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210153958829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210153958831 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210153958831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210153958831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210153958832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:39:59.810266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19684): Terminating (SIGTERM) 15:39:59.852704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19687): Terminating (SIGTERM) 15:39:59.895189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19690): Terminating (SIGTERM) 15:39:59.937912 --- ParallelTerminationStrategy: PID 19684 died... 15:39:59.958298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19684): Terminated: ok {rc=0} 15:40:00.005364 --- ParallelTerminationStrategy: PID 19687 died... 15:40:00.025280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19687): Terminated: ok {rc=0} 15:40:00.071972 --- ParallelTerminationStrategy: PID 19690 died... 15:40:00.091700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19690): Terminated: ok {rc=0} 15:40:00.179964 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:40:01.411610 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:01.426924 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:40:01.455442 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:40:01.483691 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:40:01.539505 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:40:01.573609 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:40:01.615643 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:40:02.162763 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:40:02.227531 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:02.239665 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:40:02.298558 tst mo_mt_call.py: using LAC 28944 15:40:02.427679 tst mo_mt_call.py: using RAC 129 15:40:02.556146 tst mo_mt_call.py: using CellId 28944 15:40:02.685481 tst mo_mt_call.py: using BVCI 28945 15:40:02.805426 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:02.817177 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:02.828637 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:02.840116 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:02.851664 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:02.863301 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:40:02.981324 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:40:03.102016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:03.617902 run create_hlr_db(pid=19700): Launched 15:40:03.754372 bus /sierra_2: Setting Powered False 15:40:04.820039 run create_hlr_db(pid=19700): Terminated: ok {rc=0} 15:40:05.282837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19702): Launched 15:40:05.615884 run osmo-hlr_10.42.42.2(pid=19703): Launched 15:40:05.743618 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:06.312870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19705): Launched 15:40:06.645889 run osmo-stp_10.42.42.5(pid=19706): Launched 15:40:06.768928 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:07.331591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19708): Launched 15:40:07.645540 run osmo-msc_10.42.42.6(pid=19709): Launched 15:40:07.819082 run osmo-stp_10.42.42.5(pid=19706): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19706)] 15:40:07.950938 run osmo-stp_10.42.42.5(pid=19706): stdout: | (launched: 2022-12-10_15:40:06.583856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:08.082205 run osmo-stp_10.42.42.5(pid=19706): stderr: | [0;m[38;5;43m20221210154006760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154006760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154006760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154006760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154006763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154006763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154006763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:08.211889 run osmo-stp_10.42.42.5(pid=19706): stdout: | (launched: 2022-12-10_15:40:06.583856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:08.335700 run osmo-stp_10.42.42.5(pid=19706): stderr: | [0;m[38;5;43m20221210154006760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154006760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154006760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154006760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154006763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154006763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154006763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:08.485306 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19706): Process ended prematurely: osmo-stp_10.42.42.5(pid=19706) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19706)] [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:40:08.494488 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:40:08.521222 run osmo-hlr_10.42.42.2(pid=19703): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19703)] 15:40:08.569906 run osmo-hlr_10.42.42.2(pid=19703): stdout: | (launched: 2022-12-10_15:40:05.553773) 15:40:08.619698 run osmo-hlr_10.42.42.2(pid=19703): stderr: | [0;m[1;31m20221210154005757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154005757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154005757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154005757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154005757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154005757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154005770 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154005778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154005778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154005778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:08.689267 run osmo-msc_10.42.42.6(pid=19709): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19709)] 15:40:08.737362 run osmo-msc_10.42.42.6(pid=19709): stdout: | (launched: 2022-12-10_15:40:07.586906) 15:40:08.787028 run osmo-msc_10.42.42.6(pid=19709): stderr: | [0;m[38;5;43m20221210154007864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154007865 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71c748cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154007865 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154007865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154007865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154007865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154007867 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154007867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154007867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154007867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:08.837244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19702): Terminating (SIGTERM) 15:40:08.877275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19705): Terminating (SIGTERM) 15:40:08.917438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19708): Terminating (SIGTERM) 15:40:08.958037 --- ParallelTerminationStrategy: PID 19702 died... 15:40:08.977366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19702): Terminated: ok {rc=0} 15:40:09.021957 --- ParallelTerminationStrategy: PID 19705 died... 15:40:09.040779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19705): Terminated: ok {rc=0} 15:40:09.085789 --- ParallelTerminationStrategy: PID 19708 died... 15:40:09.104503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19708): Terminated: ok {rc=0} 15:40:09.191978 bus /sierra_3: Setting Powered False 15:40:10.292490 bus /sierra_3: Setting Powered False 15:40:11.409651 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:40:12.563278 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:12.575790 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:40:12.636579 tst mo_mt_call_osmux.py: using LAC 28945 15:40:12.767690 tst mo_mt_call_osmux.py: using RAC 130 15:40:12.900358 tst mo_mt_call_osmux.py: using CellId 28945 15:40:13.029703 tst mo_mt_call_osmux.py: using BVCI 28946 15:40:13.144447 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:13.155870 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:13.167289 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:13.178699 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:13.190328 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:13.201786 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:40:13.321158 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:40:13.444482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:13.960186 run create_hlr_db(pid=19711): Launched 15:40:14.095842 bus /sierra_2: Setting Powered False 15:40:15.162203 run create_hlr_db(pid=19711): Terminated: ok {rc=0} 15:40:15.626661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19713): Launched 15:40:15.970511 run osmo-hlr_10.42.42.2(pid=19714): Launched 15:40:16.233801 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:16.972935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19716): Launched 15:40:17.301276 run osmo-stp_10.42.42.5(pid=19717): Launched 15:40:17.466965 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:18.031598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19719): Launched 15:40:18.344897 run osmo-msc_10.42.42.6(pid=19720): Launched 15:40:18.518018 run osmo-stp_10.42.42.5(pid=19717): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19717)] 15:40:18.649176 run osmo-stp_10.42.42.5(pid=19717): stdout: | (launched: 2022-12-10_15:40:17.239435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:18.779717 run osmo-stp_10.42.42.5(pid=19717): stderr: | [0;m[38;5;43m20221210154017464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154017464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154017464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154017465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154017465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154017465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154017465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:18.909539 run osmo-stp_10.42.42.5(pid=19717): stdout: | (launched: 2022-12-10_15:40:17.239435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:19.033136 run osmo-stp_10.42.42.5(pid=19717): stderr: | [0;m[38;5;43m20221210154017464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154017464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154017464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154017465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154017465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154017465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154017465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:19.181690 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19717): Process ended prematurely: osmo-stp_10.42.42.5(pid=19717) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19717)] [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:40:19.190779 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 15:40:19.217909 run osmo-hlr_10.42.42.2(pid=19714): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19714)] 15:40:19.267056 run osmo-hlr_10.42.42.2(pid=19714): stdout: | (launched: 2022-12-10_15:40:15.907709) 15:40:19.317718 run osmo-hlr_10.42.42.2(pid=19714): stderr: | [0;m[1;31m20221210154016185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154016185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154016185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154016185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154016185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154016186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154016203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154016240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154016241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154016241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:19.388808 run osmo-msc_10.42.42.6(pid=19720): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19720)] 15:40:19.437924 run osmo-msc_10.42.42.6(pid=19720): stdout: | (launched: 2022-12-10_15:40:18.286302) 15:40:19.488730 run osmo-msc_10.42.42.6(pid=19720): stderr: | [0;m[38;5;43m20221210154018561 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154018562 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f82e36e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154018562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154018562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154018562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154018562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154018564 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154018565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154018565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154018565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:19.539771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19713): Terminating (SIGTERM) 15:40:19.581077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19716): Terminating (SIGTERM) 15:40:19.622149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19719): Terminating (SIGTERM) 15:40:19.663439 --- ParallelTerminationStrategy: PID 19713 died... 15:40:19.682992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19713): Terminated: ok {rc=0} 15:40:19.728797 --- ParallelTerminationStrategy: PID 19716 died... 15:40:19.747975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19716): Terminated: ok {rc=0} 15:40:19.793497 --- ParallelTerminationStrategy: PID 19719 died... 15:40:19.812419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19719): Terminated: ok {rc=0} 15:40:19.900368 bus /sierra_3: Setting Powered False 15:40:21.000227 bus /sierra_3: Setting Powered False 15:40:22.117781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:40:23.358164 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:23.365048 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:40:23.386850 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:40:23.414553 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:40:23.467294 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:40:23.488539 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:40:23.515598 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:40:24.072929 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:40:24.125637 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:24.137223 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:40:24.194515 tst mo_mt_call.py: using LAC 28946 15:40:24.324519 tst mo_mt_call.py: using RAC 131 15:40:24.453587 tst mo_mt_call.py: using CellId 28946 15:40:24.582801 tst mo_mt_call.py: using BVCI 28947 15:40:24.705822 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:24.717499 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:24.728909 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:24.740340 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:24.753936 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:24.765440 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:40:24.881400 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:40:24.997782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:25.481323 run create_hlr_db(pid=19726): Launched 15:40:25.602556 bus /sierra_2: Setting Powered False 15:40:26.664378 run create_hlr_db(pid=19726): Terminated: ok {rc=0} 15:40:27.099152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19728): Launched 15:40:27.413304 run osmo-hlr_10.42.42.2(pid=19729): Launched 15:40:27.531497 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:28.084704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19731): Launched 15:40:28.397720 run osmo-stp_10.42.42.5(pid=19732): Launched 15:40:28.516439 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:29.082208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19735): Launched 15:40:29.397722 run osmo-msc_10.42.42.6(pid=19741): Launched 15:40:29.571074 run osmo-stp_10.42.42.5(pid=19732): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19732)] 15:40:29.703020 run osmo-stp_10.42.42.5(pid=19732): stdout: | (launched: 2022-12-10_15:40:28.339321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:29.835054 run osmo-stp_10.42.42.5(pid=19732): stderr: | [0;m[38;5;43m20221210154028514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154028514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154028514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154028514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154028515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154028515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154028515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:29.964800 run osmo-stp_10.42.42.5(pid=19732): stdout: | (launched: 2022-12-10_15:40:28.339321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:30.089164 run osmo-stp_10.42.42.5(pid=19732): stderr: | [0;m[38;5;43m20221210154028514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154028514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154028514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154028514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154028515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154028515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154028515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:30.238212 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19732): Process ended prematurely: osmo-stp_10.42.42.5(pid=19732) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19732)] [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:40:30.247329 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:40:30.274410 run osmo-hlr_10.42.42.2(pid=19729): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19729)] 15:40:30.323129 run osmo-hlr_10.42.42.2(pid=19729): stdout: | (launched: 2022-12-10_15:40:27.354448) 15:40:30.373211 run osmo-hlr_10.42.42.2(pid=19729): stderr: | [0;m[1;31m20221210154027536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154027536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154027536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154027536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154027536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154027536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154027548 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154027557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154027558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154027558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:30.442574 run osmo-msc_10.42.42.6(pid=19741): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19741)] 15:40:30.490572 run osmo-msc_10.42.42.6(pid=19741): stdout: | (launched: 2022-12-10_15:40:29.339007) 15:40:30.540424 run osmo-msc_10.42.42.6(pid=19741): stderr: | [0;m[38;5;43m20221210154029615 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154029616 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15bf4a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154029616 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154029616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154029616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154029616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154029618 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154029618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154029619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154029619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:30.590668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19728): Terminating (SIGTERM) 15:40:30.630966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19731): Terminating (SIGTERM) 15:40:30.671324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19735): Terminating (SIGTERM) 15:40:30.711658 --- ParallelTerminationStrategy: PID 19728 died... 15:40:30.730801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19728): Terminated: ok {rc=0} 15:40:30.776010 --- ParallelTerminationStrategy: PID 19731 died... 15:40:30.794686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19731): Terminated: ok {rc=0} 15:40:30.847839 --- ParallelTerminationStrategy: PID 19735 died... 15:40:30.867100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19735): Terminated: ok {rc=0} 15:40:30.967119 bus /sierra_3: Setting Powered False 15:40:32.073618 bus /sierra_3: Setting Powered False 15:40:33.199631 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:40:34.349997 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:34.362134 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:40:34.420204 tst mo_mt_call_osmux.py: using LAC 28947 15:40:34.565758 tst mo_mt_call_osmux.py: using RAC 132 15:40:34.695898 tst mo_mt_call_osmux.py: using CellId 28947 15:40:34.822536 tst mo_mt_call_osmux.py: using BVCI 28948 15:40:34.941318 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:34.953091 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:34.964514 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:34.976186 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:34.988128 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:34.999954 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:40:35.119289 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:40:35.240443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:35.742549 run create_hlr_db(pid=19743): Launched 15:40:35.873320 bus /sierra_2: Setting Powered False 15:40:36.936804 run create_hlr_db(pid=19743): Terminated: ok {rc=0} 15:40:37.369575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19745): Launched 15:40:37.672927 run osmo-hlr_10.42.42.2(pid=19746): Launched 15:40:37.787771 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:38.319953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19748): Launched 15:40:38.622132 run osmo-stp_10.42.42.5(pid=19749): Launched 15:40:38.736720 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:39.281369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19751): Launched 15:40:39.586065 run osmo-msc_10.42.42.6(pid=19752): Launched 15:40:39.753858 run osmo-stp_10.42.42.5(pid=19749): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19749)] 15:40:39.880803 run osmo-stp_10.42.42.5(pid=19749): stdout: | (launched: 2022-12-10_15:40:38.565487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:40.008418 run osmo-stp_10.42.42.5(pid=19749): stderr: | [0;m[38;5;43m20221210154038738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154038738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154038738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154038739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154038739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154038739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154038739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:40.135851 run osmo-stp_10.42.42.5(pid=19749): stdout: | (launched: 2022-12-10_15:40:38.565487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:40.255516 run osmo-stp_10.42.42.5(pid=19749): stderr: | [0;m[38;5;43m20221210154038738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154038738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154038738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154038739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154038739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154038739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154038739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:40.398886 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19749): Process ended prematurely: osmo-stp_10.42.42.5(pid=19749) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19749)] [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:40:40.407591 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 15:40:40.434187 run osmo-hlr_10.42.42.2(pid=19746): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19746)] 15:40:40.481564 run osmo-hlr_10.42.42.2(pid=19746): stdout: | (launched: 2022-12-10_15:40:37.616107) 15:40:40.530593 run osmo-hlr_10.42.42.2(pid=19746): stderr: | [0;m[1;31m20221210154037793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154037793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154037793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154037793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154037793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154037793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154037811 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154037820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154037820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154037820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:40.598957 run osmo-msc_10.42.42.6(pid=19752): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19752)] 15:40:40.646405 run osmo-msc_10.42.42.6(pid=19752): stdout: | (launched: 2022-12-10_15:40:39.528404) 15:40:40.695441 run osmo-msc_10.42.42.6(pid=19752): stderr: | [0;m[38;5;43m20221210154039801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154039801 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f29afbf2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154039801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154039801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154039801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154039802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154039803 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154039804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154039804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154039804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:40.745181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19745): Terminating (SIGTERM) 15:40:40.784795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19748): Terminating (SIGTERM) 15:40:40.824366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19751): Terminating (SIGTERM) 15:40:40.864207 --- ParallelTerminationStrategy: PID 19745 died... 15:40:40.883132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19745): Terminated: ok {rc=0} 15:40:40.927285 --- ParallelTerminationStrategy: PID 19748 died... 15:40:40.945664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19748): Terminated: ok {rc=0} 15:40:40.989628 --- ParallelTerminationStrategy: PID 19751 died... 15:40:41.008045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19751): Terminated: ok {rc=0} 15:40:41.090935 bus /sierra_3: Setting Powered False 15:40:42.186418 bus /sierra_3: Setting Powered False 15:40:43.300590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:40:44.532134 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:44.538736 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:40:44.559458 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:40:44.586190 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:40:44.640214 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:40:44.660615 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:40:44.686852 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:40:45.235209 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:40:45.284057 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:45.294999 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:40:45.350678 tst mo_mt_call.py: using LAC 28948 15:40:45.478257 tst mo_mt_call.py: using RAC 133 15:40:45.606339 tst mo_mt_call.py: using CellId 28948 15:40:45.734996 tst mo_mt_call.py: using BVCI 28949 15:40:45.864095 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:45.876530 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:45.888378 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:45.913877 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:45.935065 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:45.948044 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:40:46.087327 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:40:46.207901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:46.727638 run create_hlr_db(pid=19757): Launched 15:40:46.894575 bus /sierra_2: Setting Powered False 15:40:47.959053 run create_hlr_db(pid=19757): Terminated: ok {rc=0} 15:40:48.410159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19759): Launched 15:40:48.734560 run osmo-hlr_10.42.42.2(pid=19760): Launched 15:40:48.857119 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:49.415134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19762): Launched 15:40:49.739433 run osmo-stp_10.42.42.5(pid=19763): Launched 15:40:49.861875 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:50.445629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19765): Launched 15:40:50.769682 run osmo-msc_10.42.42.6(pid=19766): Launched 15:40:50.949219 run osmo-stp_10.42.42.5(pid=19763): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19763)] 15:40:51.084315 run osmo-stp_10.42.42.5(pid=19763): stdout: | (launched: 2022-12-10_15:40:49.678701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:51.220264 run osmo-stp_10.42.42.5(pid=19763): stderr: | [0;m[38;5;43m20221210154049872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154049872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154049872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154049872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154049875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154049875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154049875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:51.355812 run osmo-stp_10.42.42.5(pid=19763): stdout: | (launched: 2022-12-10_15:40:49.678701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:51.484467 run osmo-stp_10.42.42.5(pid=19763): stderr: | [0;m[38;5;43m20221210154049872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154049872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154049872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154049872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154049875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154049875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154049875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:51.639092 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19763): Process ended prematurely: osmo-stp_10.42.42.5(pid=19763) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19763)] [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:40:51.648209 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 15:40:51.675866 run osmo-hlr_10.42.42.2(pid=19760): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19760)] 15:40:51.726029 run osmo-hlr_10.42.42.2(pid=19760): stdout: | (launched: 2022-12-10_15:40:48.673796) 15:40:51.777743 run osmo-hlr_10.42.42.2(pid=19760): stderr: | [0;m[1;31m20221210154048875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154048876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154048876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154048876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154048876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154048876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154048888 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154048896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154048897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154048897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:51.849457 run osmo-msc_10.42.42.6(pid=19766): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19766)] 15:40:51.899383 run osmo-msc_10.42.42.6(pid=19766): stdout: | (launched: 2022-12-10_15:40:50.708907) 15:40:51.950869 run osmo-msc_10.42.42.6(pid=19766): stderr: | [0;m[38;5;43m20221210154051034 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154051034 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc877131c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154051034 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154051034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154051034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154051034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154051036 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154051036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154051037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154051037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:52.003092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19759): Terminating (SIGTERM) 15:40:52.044311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19762): Terminating (SIGTERM) 15:40:52.085698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19765): Terminating (SIGTERM) 15:40:52.127346 --- ParallelTerminationStrategy: PID 19759 died... 15:40:52.147134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19759): Terminated: ok {rc=0} 15:40:52.193178 --- ParallelTerminationStrategy: PID 19762 died... 15:40:52.212344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19762): Terminated: ok {rc=0} 15:40:52.258499 --- ParallelTerminationStrategy: PID 19765 died... 15:40:52.277940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19765): Terminated: ok {rc=0} 15:40:52.366183 bus /sierra_3: Setting Powered False 15:40:53.464458 bus /sierra_3: Setting Powered False 15:40:54.581355 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:40:55.728219 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:55.739820 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:40:55.796703 tst mo_mt_call_osmux.py: using LAC 28949 15:40:55.916579 tst mo_mt_call_osmux.py: using RAC 134 15:40:56.034368 tst mo_mt_call_osmux.py: using CellId 28949 15:40:56.154465 tst mo_mt_call_osmux.py: using BVCI 28950 15:40:56.263673 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:56.274639 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:56.285523 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:56.296456 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:56.307446 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:56.318550 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:40:56.437720 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:40:56.552468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:57.022391 run create_hlr_db(pid=19768): Launched 15:40:57.136705 bus /sierra_2: Setting Powered False 15:40:58.197219 run create_hlr_db(pid=19768): Terminated: ok {rc=0} 15:40:58.639394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19770): Launched 15:40:58.965192 run osmo-hlr_10.42.42.2(pid=19771): Launched 15:40:59.088020 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:59.644928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19773): Launched 15:40:59.969554 run osmo-stp_10.42.42.5(pid=19776): Launched 15:41:00.092250 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:00.678312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19778): Launched 15:41:01.026605 run osmo-msc_10.42.42.6(pid=19779): Launched 15:41:01.383779 run osmo-stp_10.42.42.5(pid=19776): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19776)] 15:41:01.635420 run osmo-stp_10.42.42.5(pid=19776): stdout: | (launched: 2022-12-10_15:40:59.909056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:01.831611 run osmo-stp_10.42.42.5(pid=19776): stderr: | [0;m[38;5;43m20221210154100103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154100103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154100103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154100104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154100104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154100104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154100104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:01.969307 run osmo-stp_10.42.42.5(pid=19776): stdout: | (launched: 2022-12-10_15:40:59.909056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:02.100512 run osmo-stp_10.42.42.5(pid=19776): stderr: | [0;m[38;5;43m20221210154100103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154100103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154100103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154100104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154100104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154100104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154100104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:02.256531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19776): Process ended prematurely: osmo-stp_10.42.42.5(pid=19776) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19776)] [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:41:02.266551 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 15:41:02.294809 run osmo-hlr_10.42.42.2(pid=19771): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19771)] 15:41:02.344735 run osmo-hlr_10.42.42.2(pid=19771): stdout: | (launched: 2022-12-10_15:40:58.904681) 15:41:02.396665 run osmo-hlr_10.42.42.2(pid=19771): stderr: | [0;m[1;31m20221210154059106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154059106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154059106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154059107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154059107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154059107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154059154 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154059163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154059163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154059163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:02.469203 run osmo-msc_10.42.42.6(pid=19779): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19779)] 15:41:02.519480 run osmo-msc_10.42.42.6(pid=19779): stdout: | (launched: 2022-12-10_15:41:00.960743) 15:41:02.571506 run osmo-msc_10.42.42.6(pid=19779): stderr: | [0;m[38;5;43m20221210154101457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154101457 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4bdd004c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154101458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154101458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154101458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154101458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154101460 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154101460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154101460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154101460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:02.623773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19770): Terminating (SIGTERM) 15:41:02.665831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19773): Terminating (SIGTERM) 15:41:02.708027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19778): Terminating (SIGTERM) 15:41:02.750359 --- ParallelTerminationStrategy: PID 19770 died... 15:41:02.770351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19770): Terminated: ok {rc=0} 15:41:02.816542 --- ParallelTerminationStrategy: PID 19773 died... 15:41:02.836093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19773): Terminated: ok {rc=0} 15:41:02.882448 --- ParallelTerminationStrategy: PID 19778 died... 15:41:02.902206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19778): Terminated: ok {rc=0} 15:41:02.990164 bus /sierra_3: Setting Powered False 15:41:04.089907 bus /sierra_3: Setting Powered False 15:41:05.205694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:41:06.448220 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:06.455081 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:41:06.476599 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:41:06.503846 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:41:06.556258 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:41:06.577433 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:41:06.604129 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:41:07.155559 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:41:07.206528 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:07.217873 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:41:07.279933 tst mo_mt_call.py: using LAC 28950 15:41:07.404915 tst mo_mt_call.py: using RAC 135 15:41:07.528720 tst mo_mt_call.py: using CellId 28950 15:41:07.652748 tst mo_mt_call.py: using BVCI 28951 15:41:07.769574 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:07.780867 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:07.792190 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:07.803371 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:07.814598 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:07.825820 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:41:07.939137 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:41:08.053935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:08.519841 run create_hlr_db(pid=19784): Launched 15:41:08.635562 bus /sierra_2: Setting Powered False 15:41:09.696096 run create_hlr_db(pid=19784): Terminated: ok {rc=0} 15:41:10.115523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19786): Launched 15:41:10.415411 run osmo-hlr_10.42.42.2(pid=19787): Launched 15:41:10.528455 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:11.047528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19789): Launched 15:41:11.348354 run osmo-stp_10.42.42.5(pid=19790): Launched 15:41:11.462256 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:12.028158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19792): Launched 15:41:12.320267 run osmo-msc_10.42.42.6(pid=19793): Launched 15:41:12.484282 run osmo-stp_10.42.42.5(pid=19790): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19790)] 15:41:12.610019 run osmo-stp_10.42.42.5(pid=19790): stdout: | (launched: 2022-12-10_15:41:11.291570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:12.735514 run osmo-stp_10.42.42.5(pid=19790): stderr: | [0;m[38;5;43m20221210154111463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154111463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154111463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154111463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154111464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154111464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154111464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:12.858707 run osmo-stp_10.42.42.5(pid=19790): stdout: | (launched: 2022-12-10_15:41:11.291570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:12.976200 run osmo-stp_10.42.42.5(pid=19790): stderr: | [0;m[38;5;43m20221210154111463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154111463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154111463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154111463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154111464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154111464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154111464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:13.117061 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19790): Process ended prematurely: osmo-stp_10.42.42.5(pid=19790) [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19790)] [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:41:13.125947 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 15:41:13.152117 run osmo-hlr_10.42.42.2(pid=19787): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19787)] 15:41:13.199692 run osmo-hlr_10.42.42.2(pid=19787): stdout: | (launched: 2022-12-10_15:41:10.359299) 15:41:13.248889 run osmo-hlr_10.42.42.2(pid=19787): stderr: | [0;m[1;31m20221210154110538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154110538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154110538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154110538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154110538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154110538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154110558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154110567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154110567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154110567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:13.317070 run osmo-msc_10.42.42.6(pid=19793): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19793)] 15:41:13.364084 run osmo-msc_10.42.42.6(pid=19793): stdout: | (launched: 2022-12-10_15:41:12.267116) 15:41:13.412845 run osmo-msc_10.42.42.6(pid=19793): stderr: | [0;m[38;5;43m20221210154112537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154112537 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f93a6a4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154112538 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154112538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154112538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154112538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154112540 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154112540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154112540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154112540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:13.462025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19786): Terminating (SIGTERM) 15:41:13.501295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19789): Terminating (SIGTERM) 15:41:13.540745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19792): Terminating (SIGTERM) 15:41:13.580566 --- ParallelTerminationStrategy: PID 19786 died... 15:41:13.599418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19786): Terminated: ok {rc=0} 15:41:13.643652 --- ParallelTerminationStrategy: PID 19789 died... 15:41:13.661975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19789): Terminated: ok {rc=0} 15:41:13.706080 --- ParallelTerminationStrategy: PID 19792 died... 15:41:13.724621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19792): Terminated: ok {rc=0} 15:41:13.808687 bus /sierra_3: Setting Powered False 15:41:14.903598 bus /sierra_3: Setting Powered False 15:41:16.019360 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:41:17.178249 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:17.190603 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:41:17.249118 tst mo_mt_call_osmux.py: using LAC 28951 15:41:17.373635 tst mo_mt_call_osmux.py: using RAC 136 15:41:17.499801 tst mo_mt_call_osmux.py: using CellId 28951 15:41:17.626950 tst mo_mt_call_osmux.py: using BVCI 28952 15:41:17.744718 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:17.756455 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:17.767952 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:17.779964 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:17.792013 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:17.804157 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:41:17.921216 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:41:18.039425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:18.528629 run create_hlr_db(pid=19795): Launched 15:41:18.656488 bus /sierra_2: Setting Powered False 15:41:19.715840 run create_hlr_db(pid=19795): Terminated: ok {rc=0} 15:41:20.153364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19797): Launched 15:41:20.468513 run osmo-hlr_10.42.42.2(pid=19798): Launched 15:41:20.588091 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:21.132596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19800): Launched 15:41:21.446811 run osmo-stp_10.42.42.5(pid=19801): Launched 15:41:21.566279 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:22.137384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19803): Launched 15:41:22.452626 run osmo-msc_10.42.42.6(pid=19804): Launched 15:41:22.627521 run osmo-stp_10.42.42.5(pid=19801): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19801)] 15:41:22.760259 run osmo-stp_10.42.42.5(pid=19801): stdout: | (launched: 2022-12-10_15:41:21.390218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:22.893874 run osmo-stp_10.42.42.5(pid=19801): stderr: | [0;m[38;5;43m20221210154121581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154121581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154121581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154121582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154121582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154121582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154121582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:23.027881 run osmo-stp_10.42.42.5(pid=19801): stdout: | (launched: 2022-12-10_15:41:21.390218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:23.154534 run osmo-stp_10.42.42.5(pid=19801): stderr: | [0;m[38;5;43m20221210154121581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154121581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154121581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154121582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154121582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154121582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154121582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:23.305548 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19801): Process ended prematurely: osmo-stp_10.42.42.5(pid=19801) [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19801)] [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:41:23.315178 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:41:23.342801 run osmo-hlr_10.42.42.2(pid=19798): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19798)] 15:41:23.393066 run osmo-hlr_10.42.42.2(pid=19798): stdout: | (launched: 2022-12-10_15:41:20.411790) 15:41:23.444719 run osmo-hlr_10.42.42.2(pid=19798): stderr: | [0;m[1;31m20221210154120608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154120608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154120608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154120608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154120608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154120609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154120629 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154120640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154120640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154120640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:23.517015 run osmo-msc_10.42.42.6(pid=19804): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19804)] 15:41:23.567148 run osmo-msc_10.42.42.6(pid=19804): stdout: | (launched: 2022-12-10_15:41:22.396005) 15:41:23.619055 run osmo-msc_10.42.42.6(pid=19804): stderr: | [0;m[38;5;43m20221210154122719 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154122719 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ec365ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154122719 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154122719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154122719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154122719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154122721 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154122721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154122722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154122722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:23.671021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19797): Terminating (SIGTERM) 15:41:23.712846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19800): Terminating (SIGTERM) 15:41:23.755154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19803): Terminating (SIGTERM) 15:41:23.797128 --- ParallelTerminationStrategy: PID 19797 died... 15:41:23.817353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19797): Terminated: ok {rc=0} 15:41:23.864064 --- ParallelTerminationStrategy: PID 19800 died... 15:41:23.883753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19800): Terminated: ok {rc=0} 15:41:23.930013 --- ParallelTerminationStrategy: PID 19803 died... 15:41:23.949611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19803): Terminated: ok {rc=0} 15:41:24.037498 bus /sierra_3: Setting Powered False 15:41:25.136310 bus /sierra_3: Setting Powered False 15:41:26.249988 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:41:27.486467 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:27.493893 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:41:27.514665 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:41:27.541320 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:41:27.594027 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:41:27.614855 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:41:27.640915 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:41:28.189502 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:41:28.237211 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:28.248031 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:41:28.303940 tst mo_mt_call.py: using LAC 28952 15:41:28.429533 tst mo_mt_call.py: using RAC 137 15:41:28.553222 tst mo_mt_call.py: using CellId 28952 15:41:28.678980 tst mo_mt_call.py: using BVCI 28953 15:41:28.795700 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:28.807485 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:28.818916 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:28.830613 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:28.842398 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:28.854050 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:41:28.968297 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:41:29.081215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:29.538738 run create_hlr_db(pid=19810): Launched 15:41:29.652088 bus /sierra_2: Setting Powered False 15:41:30.711559 run create_hlr_db(pid=19810): Terminated: ok {rc=0} 15:41:31.179046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19812): Launched 15:41:31.519865 run osmo-hlr_10.42.42.2(pid=19813): Launched 15:41:31.738318 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:32.365888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19815): Launched 15:41:32.680596 run osmo-stp_10.42.42.5(pid=19816): Launched 15:41:32.800354 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:33.369679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19818): Launched 15:41:33.685433 run osmo-msc_10.42.42.6(pid=19819): Launched 15:41:33.861412 run osmo-stp_10.42.42.5(pid=19816): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19816)] 15:41:33.994477 run osmo-stp_10.42.42.5(pid=19816): stdout: | (launched: 2022-12-10_15:41:32.623900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:34.128921 run osmo-stp_10.42.42.5(pid=19816): stderr: | [0;m[38;5;43m20221210154132815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154132815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154132815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154132816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154132816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154132816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154132816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:34.262164 run osmo-stp_10.42.42.5(pid=19816): stdout: | (launched: 2022-12-10_15:41:32.623900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:34.388807 run osmo-stp_10.42.42.5(pid=19816): stderr: | [0;m[38;5;43m20221210154132815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154132815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154132815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154132816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154132816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154132816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154132816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:34.540361 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19816): Process ended prematurely: osmo-stp_10.42.42.5(pid=19816) [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19816)] [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:41:34.549975 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:41:34.577785 run osmo-hlr_10.42.42.2(pid=19813): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19813)] 15:41:34.628124 run osmo-hlr_10.42.42.2(pid=19813): stdout: | (launched: 2022-12-10_15:41:31.451605) 15:41:34.680311 run osmo-hlr_10.42.42.2(pid=19813): stderr: | [0;m[1;31m20221210154131679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154131679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154131679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154131679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154131679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154131679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154131698 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154131719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154131720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154131720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:34.752789 run osmo-msc_10.42.42.6(pid=19819): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19819)] 15:41:34.803166 run osmo-msc_10.42.42.6(pid=19819): stdout: | (launched: 2022-12-10_15:41:33.628486) 15:41:34.855173 run osmo-msc_10.42.42.6(pid=19819): stderr: | [0;m[38;5;43m20221210154133948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154133949 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6138112c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154133949 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154133949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154133949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154133949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154133951 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154133951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154133951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154133952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:34.907444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19812): Terminating (SIGTERM) 15:41:34.949461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19815): Terminating (SIGTERM) 15:41:34.991547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19818): Terminating (SIGTERM) 15:41:35.034106 --- ParallelTerminationStrategy: PID 19812 died... 15:41:35.054019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19812): Terminated: ok {rc=0} 15:41:35.101203 --- ParallelTerminationStrategy: PID 19815 died... 15:41:35.121100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19815): Terminated: ok {rc=0} 15:41:35.168156 --- ParallelTerminationStrategy: PID 19818 died... 15:41:35.187932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19818): Terminated: ok {rc=0} 15:41:35.275325 bus /sierra_3: Setting Powered False 15:41:36.373694 bus /sierra_3: Setting Powered False 15:41:37.489970 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:41:38.637968 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:38.650228 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:41:38.708800 tst mo_mt_call_osmux.py: using LAC 28953 15:41:38.834470 tst mo_mt_call_osmux.py: using RAC 138 15:41:38.952786 tst mo_mt_call_osmux.py: using CellId 28953 15:41:39.068867 tst mo_mt_call_osmux.py: using BVCI 28954 15:41:39.185644 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:39.197442 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:39.208817 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:39.220446 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:39.231998 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:39.243725 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:41:39.358724 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:41:39.474831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:39.926687 run create_hlr_db(pid=19821): Launched 15:41:40.039028 bus /sierra_2: Setting Powered False 15:41:41.098836 run create_hlr_db(pid=19821): Terminated: ok {rc=0} 15:41:41.507767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19823): Launched 15:41:41.800033 run osmo-hlr_10.42.42.2(pid=19824): Launched 15:41:41.911349 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:42.415909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19826): Launched 15:41:42.707500 run osmo-stp_10.42.42.5(pid=19827): Launched 15:41:42.818403 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:43.349225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19829): Launched 15:41:43.642927 run osmo-msc_10.42.42.6(pid=19830): Launched 15:41:43.806394 run osmo-stp_10.42.42.5(pid=19827): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19827)] 15:41:43.930650 run osmo-stp_10.42.42.5(pid=19827): stdout: | (launched: 2022-12-10_15:41:42.654545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:44.055241 run osmo-stp_10.42.42.5(pid=19827): stderr: | [0;m[38;5;43m20221210154142821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154142821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154142821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154142822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154142824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154142824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154142824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:44.177431 run osmo-stp_10.42.42.5(pid=19827): stdout: | (launched: 2022-12-10_15:41:42.654545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:44.294567 run osmo-stp_10.42.42.5(pid=19827): stderr: | [0;m[38;5;43m20221210154142821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154142821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154142821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154142822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154142824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154142824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154142824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:44.434755 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19827): Process ended prematurely: osmo-stp_10.42.42.5(pid=19827) [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19827)] [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:41:44.443626 tst mo_mt_call_osmux.py:8: Test FAILED (5.8 sec) 15:41:44.469963 run osmo-hlr_10.42.42.2(pid=19824): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19824)] 15:41:44.517787 run osmo-hlr_10.42.42.2(pid=19824): stdout: | (launched: 2022-12-10_15:41:41.746790) 15:41:44.567071 run osmo-hlr_10.42.42.2(pid=19824): stderr: | [0;m[1;31m20221210154141922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154141923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154141923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154141923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154141923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154141923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154141935 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154141943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154141943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154141943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:44.635182 run osmo-msc_10.42.42.6(pid=19830): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19830)] 15:41:44.682536 run osmo-msc_10.42.42.6(pid=19830): stdout: | (launched: 2022-12-10_15:41:43.589259) 15:41:44.731569 run osmo-msc_10.42.42.6(pid=19830): stderr: | [0;m[38;5;43m20221210154143862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154143862 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1c59d7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154143862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154143862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154143863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154143863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154143864 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154143865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154143865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154143865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:44.781035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19823): Terminating (SIGTERM) 15:41:44.820695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19826): Terminating (SIGTERM) 15:41:44.860321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19829): Terminating (SIGTERM) 15:41:44.899775 --- ParallelTerminationStrategy: PID 19823 died... 15:41:44.918839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19823): Terminated: ok {rc=0} 15:41:44.962825 --- ParallelTerminationStrategy: PID 19826 died... 15:41:44.981376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19826): Terminated: ok {rc=0} 15:41:45.025527 --- ParallelTerminationStrategy: PID 19829 died... 15:41:45.043957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19829): Terminated: ok {rc=0} 15:41:45.126620 bus /sierra_3: Setting Powered False 15:41:46.235446 bus /sierra_3: Setting Powered False 15:41:47.359864 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:41:48.599787 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:48.607106 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:41:48.628773 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:41:48.655913 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:41:48.706754 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:41:48.728029 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:41:48.754846 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:41:49.309904 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:41:49.360566 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:49.371927 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:41:49.428375 tst mo_mt_call.py: using LAC 28954 15:41:49.551574 tst mo_mt_call.py: using RAC 139 15:41:49.674669 tst mo_mt_call.py: using CellId 28954 15:41:49.796389 tst mo_mt_call.py: using BVCI 28955 15:41:49.910139 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:49.921571 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:49.932740 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:49.943963 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:49.955186 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:49.966494 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:41:50.079098 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:41:50.196074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:50.686099 run create_hlr_db(pid=19835): Launched 15:41:50.814166 bus /sierra_2: Setting Powered False 15:41:51.877156 run create_hlr_db(pid=19835): Terminated: ok {rc=0} 15:41:52.317372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19837): Launched 15:41:52.631666 run osmo-hlr_10.42.42.2(pid=19838): Launched 15:41:52.751418 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:53.292572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19840): Launched 15:41:53.607523 run osmo-stp_10.42.42.5(pid=19841): Launched 15:41:53.729128 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:54.298789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19843): Launched 15:41:54.613163 run osmo-msc_10.42.42.6(pid=19844): Launched 15:41:54.790214 run osmo-stp_10.42.42.5(pid=19841): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19841)] 15:41:54.923992 run osmo-stp_10.42.42.5(pid=19841): stdout: | (launched: 2022-12-10_15:41:53.550772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:55.058934 run osmo-stp_10.42.42.5(pid=19841): stderr: | [0;m[38;5;43m20221210154153743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154153744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154153744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154153744 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154153745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154153745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154153745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:55.192816 run osmo-stp_10.42.42.5(pid=19841): stdout: | (launched: 2022-12-10_15:41:53.550772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:55.319591 run osmo-stp_10.42.42.5(pid=19841): stderr: | [0;m[38;5;43m20221210154153743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154153744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154153744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154153744 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154153745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154153745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154153745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:55.470936 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19841): Process ended prematurely: osmo-stp_10.42.42.5(pid=19841) [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19841)] [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:41:55.480163 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:41:55.507583 run osmo-hlr_10.42.42.2(pid=19838): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19838)] 15:41:55.557313 run osmo-hlr_10.42.42.2(pid=19838): stdout: | (launched: 2022-12-10_15:41:52.574996) 15:41:55.608850 run osmo-hlr_10.42.42.2(pid=19838): stderr: | [0;m[1;31m20221210154152774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154152774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154152774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154152774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154152774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154152774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154152789 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154152799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154152799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154152799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:55.680650 run osmo-msc_10.42.42.6(pid=19844): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19844)] 15:41:55.731063 run osmo-msc_10.42.42.6(pid=19844): stdout: | (launched: 2022-12-10_15:41:54.556355) 15:41:55.782747 run osmo-msc_10.42.42.6(pid=19844): stderr: | [0;m[38;5;43m20221210154154878 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154154878 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a2447dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154154878 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154154878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154154879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154154879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154154880 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154154881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154154881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154154881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:55.834237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19837): Terminating (SIGTERM) 15:41:55.875813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19840): Terminating (SIGTERM) 15:41:55.917521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19843): Terminating (SIGTERM) 15:41:55.959359 --- ParallelTerminationStrategy: PID 19837 died... 15:41:55.979323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19837): Terminated: ok {rc=0} 15:41:56.025678 --- ParallelTerminationStrategy: PID 19840 died... 15:41:56.045254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19840): Terminated: ok {rc=0} 15:41:56.091463 --- ParallelTerminationStrategy: PID 19843 died... 15:41:56.110949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19843): Terminated: ok {rc=0} 15:41:56.198845 bus /sierra_3: Setting Powered False 15:41:57.298416 bus /sierra_3: Setting Powered False 15:41:58.414393 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:41:59.558954 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:59.570692 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:41:59.629449 tst mo_mt_call_osmux.py: using LAC 28955 15:41:59.754836 tst mo_mt_call_osmux.py: using RAC 140 15:41:59.878125 tst mo_mt_call_osmux.py: using CellId 28955 15:42:00.002031 tst mo_mt_call_osmux.py: using BVCI 28956 15:42:00.118473 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:00.129991 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:00.141419 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:00.152685 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:00.164050 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:00.175457 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:42:00.289678 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:42:00.408671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:00.892096 run create_hlr_db(pid=19848): Launched 15:42:01.052802 bus /sierra_2: Setting Powered False 15:42:02.129651 run create_hlr_db(pid=19848): Terminated: ok {rc=0} 15:42:02.572747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19855): Launched 15:42:02.887832 run osmo-hlr_10.42.42.2(pid=19856): Launched 15:42:03.006666 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:03.552779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19858): Launched 15:42:03.867283 run osmo-stp_10.42.42.5(pid=19859): Launched 15:42:03.986695 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:04.554921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19861): Launched 15:42:04.869426 run osmo-msc_10.42.42.6(pid=19862): Launched 15:42:05.044808 run osmo-stp_10.42.42.5(pid=19859): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19859)] 15:42:05.177598 run osmo-stp_10.42.42.5(pid=19859): stdout: | (launched: 2022-12-10_15:42:03.810504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:05.311413 run osmo-stp_10.42.42.5(pid=19859): stderr: | [0;m[38;5;43m20221210154203999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154203999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154203999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154203999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154204000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154204000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154204000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:05.445864 run osmo-stp_10.42.42.5(pid=19859): stdout: | (launched: 2022-12-10_15:42:03.810504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:05.571873 run osmo-stp_10.42.42.5(pid=19859): stderr: | [0;m[38;5;43m20221210154203999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154203999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154203999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154203999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154204000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154204000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154204000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:05.722592 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19859): Process ended prematurely: osmo-stp_10.42.42.5(pid=19859) [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19859)] [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:42:05.732139 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:42:05.759651 run osmo-hlr_10.42.42.2(pid=19856): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19856)] 15:42:05.809519 run osmo-hlr_10.42.42.2(pid=19856): stdout: | (launched: 2022-12-10_15:42:02.831074) 15:42:05.860870 run osmo-hlr_10.42.42.2(pid=19856): stderr: | [0;m[1;31m20221210154203029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154203029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154203029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154203030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154203030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154203030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154203042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154203051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154203051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154203051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:05.932635 run osmo-msc_10.42.42.6(pid=19862): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19862)] 15:42:05.982161 run osmo-msc_10.42.42.6(pid=19862): stdout: | (launched: 2022-12-10_15:42:04.812614) 15:42:06.033536 run osmo-msc_10.42.42.6(pid=19862): stderr: | [0;m[38;5;43m20221210154205132 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154205132 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f356f63ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154205132 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154205132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154205132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154205132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154205134 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154205135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154205135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154205135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:06.085195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19855): Terminating (SIGTERM) 15:42:06.127034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19858): Terminating (SIGTERM) 15:42:06.168556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19861): Terminating (SIGTERM) 15:42:06.210251 --- ParallelTerminationStrategy: PID 19855 died... 15:42:06.229712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19855): Terminated: ok {rc=0} 15:42:06.275424 --- ParallelTerminationStrategy: PID 19858 died... 15:42:06.294625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19858): Terminated: ok {rc=0} 15:42:06.340294 --- ParallelTerminationStrategy: PID 19861 died... 15:42:06.359556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19861): Terminated: ok {rc=0} 15:42:06.445535 bus /sierra_3: Setting Powered False 15:42:07.542964 bus /sierra_3: Setting Powered False 15:42:08.658659 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:42:09.894741 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:42:09.900517 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:42:09.921577 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:42:09.948595 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:42:10.000462 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:42:10.021700 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:42:10.048845 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:42:10.598715 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:42:10.649309 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:10.660417 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:42:10.718000 tst mo_mt_call.py: using LAC 28956 15:42:10.843743 tst mo_mt_call.py: using RAC 141 15:42:10.967903 tst mo_mt_call.py: using CellId 28956 15:42:11.092898 tst mo_mt_call.py: using BVCI 28957 15:42:11.207192 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:11.218513 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:11.229545 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:11.240463 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:11.251456 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:11.262564 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:42:11.375019 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:42:11.494639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:11.982733 run create_hlr_db(pid=19867): Launched 15:42:12.110326 bus /sierra_2: Setting Powered False 15:42:13.173194 run create_hlr_db(pid=19867): Terminated: ok {rc=0} 15:42:13.613069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19869): Launched 15:42:13.927024 run osmo-hlr_10.42.42.2(pid=19870): Launched 15:42:14.045953 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:14.587050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19872): Launched 15:42:14.901908 run osmo-stp_10.42.42.5(pid=19873): Launched 15:42:15.021587 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:15.591508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19875): Launched 15:42:15.929787 run osmo-msc_10.42.42.6(pid=19876): Launched 15:42:16.298319 run osmo-stp_10.42.42.5(pid=19873): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19873)] 15:42:16.634252 run osmo-stp_10.42.42.5(pid=19873): stdout: | (launched: 2022-12-10_15:42:14.845262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:16.978650 run osmo-stp_10.42.42.5(pid=19873): stderr: | [0;m[38;5;43m20221210154215034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154215034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154215034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154215035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154215037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154215037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154215037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:17.266656 run osmo-stp_10.42.42.5(pid=19873): stdout: | (launched: 2022-12-10_15:42:14.845262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:17.387208 run osmo-stp_10.42.42.5(pid=19873): stderr: | [0;m[38;5;43m20221210154215034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154215034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154215034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154215035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154215037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154215037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154215037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:17.530209 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19873): Process ended prematurely: osmo-stp_10.42.42.5(pid=19873) [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19873)] [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:42:17.539283 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 15:42:17.566678 run osmo-hlr_10.42.42.2(pid=19870): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19870)] 15:42:17.615867 run osmo-hlr_10.42.42.2(pid=19870): stdout: | (launched: 2022-12-10_15:42:13.870455) 15:42:17.666539 run osmo-hlr_10.42.42.2(pid=19870): stderr: | [0;m[1;31m20221210154214068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154214068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154214068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154214068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154214068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154214068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154214081 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154214089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154214089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154214089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:17.736393 run osmo-msc_10.42.42.6(pid=19876): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19876)] 15:42:17.785256 run osmo-msc_10.42.42.6(pid=19876): stdout: | (launched: 2022-12-10_15:42:15.850161) 15:42:17.835491 run osmo-msc_10.42.42.6(pid=19876): stderr: | [0;m[38;5;43m20221210154216712 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154216712 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62dd59ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154216712 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154216713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154216713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154216713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154216718 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154216718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154216718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154216718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:17.885843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19869): Terminating (SIGTERM) 15:42:17.926213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19872): Terminating (SIGTERM) 15:42:17.966834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19875): Terminating (SIGTERM) 15:42:18.008002 --- ParallelTerminationStrategy: PID 19869 died... 15:42:18.027221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19869): Terminated: ok {rc=0} 15:42:18.073003 --- ParallelTerminationStrategy: PID 19872 died... 15:42:18.091708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19872): Terminated: ok {rc=0} 15:42:18.137356 --- ParallelTerminationStrategy: PID 19875 died... 15:42:18.156160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19875): Terminated: ok {rc=0} 15:42:18.244040 bus /sierra_3: Setting Powered False 15:42:19.344066 bus /sierra_3: Setting Powered False 15:42:20.459896 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:42:21.605910 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:21.617339 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:42:21.673874 tst mo_mt_call_osmux.py: using LAC 28957 15:42:21.790479 tst mo_mt_call_osmux.py: using RAC 142 15:42:21.908734 tst mo_mt_call_osmux.py: using CellId 28957 15:42:22.025612 tst mo_mt_call_osmux.py: using BVCI 28958 15:42:22.141766 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:22.153269 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:22.164470 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:22.175863 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:22.187270 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:22.198846 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:42:22.313317 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:42:22.426781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:22.880000 run create_hlr_db(pid=19878): Launched 15:42:22.992112 bus /sierra_2: Setting Powered False 15:42:24.051453 run create_hlr_db(pid=19878): Terminated: ok {rc=0} 15:42:24.462354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19880): Launched 15:42:24.755207 run osmo-hlr_10.42.42.2(pid=19881): Launched 15:42:24.867932 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:25.384224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19883): Launched 15:42:25.677606 run osmo-stp_10.42.42.5(pid=19884): Launched 15:42:25.789889 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:26.320792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19886): Launched 15:42:26.614028 run osmo-msc_10.42.42.6(pid=19887): Launched 15:42:26.778576 run osmo-stp_10.42.42.5(pid=19884): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19884)] 15:42:26.903690 run osmo-stp_10.42.42.5(pid=19884): stdout: | (launched: 2022-12-10_15:42:25.624304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:27.028860 run osmo-stp_10.42.42.5(pid=19884): stderr: | [0;m[38;5;43m20221210154225792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154225792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154225792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154225793 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154225793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154225793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154225793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:27.151670 run osmo-stp_10.42.42.5(pid=19884): stdout: | (launched: 2022-12-10_15:42:25.624304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:27.269047 run osmo-stp_10.42.42.5(pid=19884): stderr: | [0;m[38;5;43m20221210154225792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154225792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154225792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154225793 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154225793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154225793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154225793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:27.409592 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19884): Process ended prematurely: osmo-stp_10.42.42.5(pid=19884) [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19884)] [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:42:27.418364 tst mo_mt_call_osmux.py:8: Test FAILED (5.8 sec) 15:42:27.444873 run osmo-hlr_10.42.42.2(pid=19881): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19881)] 15:42:27.492704 run osmo-hlr_10.42.42.2(pid=19881): stdout: | (launched: 2022-12-10_15:42:24.702185) 15:42:27.542334 run osmo-hlr_10.42.42.2(pid=19881): stderr: | [0;m[1;31m20221210154224875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154224875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154224875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154224875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154224875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154224875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154224887 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154224895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154224896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154224896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:27.611266 run osmo-msc_10.42.42.6(pid=19887): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19887)] 15:42:27.658657 run osmo-msc_10.42.42.6(pid=19887): stdout: | (launched: 2022-12-10_15:42:26.560771) 15:42:27.707309 run osmo-msc_10.42.42.6(pid=19887): stderr: | [0;m[38;5;43m20221210154226828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154226828 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efed95f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154226828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154226829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154226829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154226829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154226831 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154226832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154226832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154226832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:27.756711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19880): Terminating (SIGTERM) 15:42:27.796275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19883): Terminating (SIGTERM) 15:42:27.835774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19886): Terminating (SIGTERM) 15:42:27.875471 --- ParallelTerminationStrategy: PID 19880 died... 15:42:27.894315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19880): Terminated: ok {rc=0} 15:42:27.938165 --- ParallelTerminationStrategy: PID 19883 died... 15:42:27.956514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19883): Terminated: ok {rc=0} 15:42:28.001339 --- ParallelTerminationStrategy: PID 19886 died... 15:42:28.019869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19886): Terminated: ok {rc=0} 15:42:28.105466 bus /sierra_3: Setting Powered False 15:42:29.204637 bus /sierra_3: Setting Powered False 15:42:30.319529 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 emergency:sysmo --------------------------------------------------------------------- 15:42:31.580450 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:42:31.584557 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 15:42:31.609826 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 15:42:31.637922 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 15:42:31.725529 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 15:42:31.761704 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 15:42:31.790356 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 15:42:32.355928 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2376 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 15:42:32.361408 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:32.372324 tst emergency:sysmo: Using 1 x bts (candidates: 1) 15:42:32.409209 tst emergency_mo_mt_call.py: using LAC 28958 15:42:32.531669 tst emergency_mo_mt_call.py: using RAC 143 15:42:32.653421 tst emergency_mo_mt_call.py: using CellId 28958 15:42:32.769656 tst emergency_mo_mt_call.py: using BVCI 28959 15:42:32.884188 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:32.895463 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:32.906601 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:32.917795 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:32.928923 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:32.940159 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:33.054252 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:33.169497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:33.651636 run create_hlr_db(pid=19892): Launched 15:42:33.767168 bus /sierra_2: Setting Powered False 15:42:34.825952 run create_hlr_db(pid=19892): Terminated: ok {rc=0} 15:42:35.252213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19894): Launched 15:42:35.562303 run osmo-hlr_10.42.42.2(pid=19895): Launched 15:42:35.681494 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:36.203892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19897): Launched 15:42:36.491868 run osmo-stp_10.42.42.5(pid=19898): Launched 15:42:36.612899 tst emergency_mo_mt_call.py: using MSISDN 7782 15:42:36.776061 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:37.294805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19900): Launched 15:42:37.582216 run osmo-msc_10.42.42.6(pid=19901): Launched 15:42:37.742765 run osmo-stp_10.42.42.5(pid=19898): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19898)] 15:42:37.869943 run osmo-stp_10.42.42.5(pid=19898): stdout: | (launched: 2022-12-10_15:42:36.439238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:37.993625 run osmo-stp_10.42.42.5(pid=19898): stderr: | [0;m[38;5;43m20221210154236607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154236608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154236608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154236608 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154236609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154236609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154236609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:38.114090 run osmo-stp_10.42.42.5(pid=19898): stdout: | (launched: 2022-12-10_15:42:36.439238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:38.229531 run osmo-stp_10.42.42.5(pid=19898): stderr: | [0;m[38;5;43m20221210154236607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154236608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154236608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154236608 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154236609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154236609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154236609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:38.367320 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19898): Process ended prematurely: osmo-stp_10.42.42.5(pid=19898) [trial-2376↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19898)] [trial-2376↪emergency:sysmo↪emergency_mo_mt_call.py:19] 15:42:38.375462 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 15:42:38.401574 run osmo-hlr_10.42.42.2(pid=19895): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19895)] 15:42:38.449502 run osmo-hlr_10.42.42.2(pid=19895): stdout: | (launched: 2022-12-10_15:42:35.506096) 15:42:38.499064 run osmo-hlr_10.42.42.2(pid=19895): stderr: | [0;m[1;31m20221210154235704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154235704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154235704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154235704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154235704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154235704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154235716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154235725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154235725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154235725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:38.568498 run osmo-msc_10.42.42.6(pid=19901): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19901)] 15:42:38.616785 run osmo-msc_10.42.42.6(pid=19901): stdout: | (launched: 2022-12-10_15:42:37.529632) 15:42:38.666565 run osmo-msc_10.42.42.6(pid=19901): stderr: | [0;m[38;5;43m20221210154237800 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154237800 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa456805c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154237800 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154237800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154237800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154237800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154237802 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154237803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154237803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154237803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:38.716697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19894): Terminating (SIGTERM) 15:42:38.756633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19897): Terminating (SIGTERM) 15:42:38.796688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19900): Terminating (SIGTERM) 15:42:38.836873 --- ParallelTerminationStrategy: PID 19894 died... 15:42:38.855954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19894): Terminated: ok {rc=0} 15:42:38.900306 --- ParallelTerminationStrategy: PID 19897 died... 15:42:38.918857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19897): Terminated: ok {rc=0} 15:42:38.963603 --- ParallelTerminationStrategy: PID 19900 died... 15:42:38.982090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19900): Terminated: ok {rc=0} 15:42:39.066947 bus /sierra_3: Setting Powered False 15:42:40.167109 bus /sierra_3: Setting Powered False 15:42:41.280685 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 15:42:42.367103 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:42.379256 tst emergency:sysmo: Using 1 x bts (candidates: 1) 15:42:42.417906 tst emergency_preemptive_call.py: using LAC 28959 15:42:42.541775 tst emergency_preemptive_call.py: using RAC 144 15:42:42.664916 tst emergency_preemptive_call.py: using CellId 28959 15:42:42.786464 tst emergency_preemptive_call.py: using BVCI 28960 15:42:42.899179 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:42.910371 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:42.921226 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:42.931947 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:42.942751 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:42.953492 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:43.069141 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:43.182273 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:43.298518 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:43.411624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:43.859680 run create_hlr_db(pid=19903): Launched 15:42:43.970059 bus /sierra_2: Setting Powered False 15:42:45.027992 run create_hlr_db(pid=19903): Terminated: ok {rc=0} 15:42:45.454162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19905): Launched 15:42:45.765805 run osmo-hlr_10.42.42.2(pid=19906): Launched 15:42:45.947058 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:46.583168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19908): Launched 15:42:46.912162 run osmo-stp_10.42.42.5(pid=19909): Launched 15:42:47.071684 tst emergency_preemptive_call.py: using MSISDN 7783 15:42:47.307928 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:47.967993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19911): Launched 15:42:48.278918 run osmo-msc_10.42.42.6(pid=19912): Launched 15:42:48.457594 run osmo-stp_10.42.42.5(pid=19909): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19909)] 15:42:48.587816 run osmo-stp_10.42.42.5(pid=19909): stdout: | (launched: 2022-12-10_15:42:46.845948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:48.719305 run osmo-stp_10.42.42.5(pid=19909): stderr: | [0;m[38;5;43m20221210154247234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154247234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154247234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154247235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154247235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154247235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154247235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:48.850456 run osmo-stp_10.42.42.5(pid=19909): stdout: | (launched: 2022-12-10_15:42:46.845948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:48.974633 run osmo-stp_10.42.42.5(pid=19909): stderr: | [0;m[38;5;43m20221210154247234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154247234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154247234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154247235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154247235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154247235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154247235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:49.122922 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19909): Process ended prematurely: osmo-stp_10.42.42.5(pid=19909) [trial-2376↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19909)] [trial-2376↪emergency:sysmo↪emergency_preemptive_call.py:32] 15:42:49.131820 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 15:42:49.159154 run osmo-hlr_10.42.42.2(pid=19906): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19906)] 15:42:49.208831 run osmo-hlr_10.42.42.2(pid=19906): stdout: | (launched: 2022-12-10_15:42:45.708827) 15:42:49.260101 run osmo-hlr_10.42.42.2(pid=19906): stderr: | [0;m[1;31m20221210154245967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154245967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154245967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154245967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154245967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154245967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154245983 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154246002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154246002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154246003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:49.331578 run osmo-msc_10.42.42.6(pid=19912): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19912)] 15:42:49.381210 run osmo-msc_10.42.42.6(pid=19912): stdout: | (launched: 2022-12-10_15:42:48.222856) 15:42:49.432092 run osmo-msc_10.42.42.6(pid=19912): stderr: | [0;m[38;5;43m20221210154248544 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154248544 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe2c95bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154248544 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154248544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154248545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154248545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154248547 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154248547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154248547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154248547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:49.483335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19905): Terminating (SIGTERM) 15:42:49.524614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19908): Terminating (SIGTERM) 15:42:49.565874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19911): Terminating (SIGTERM) 15:42:49.607414 --- ParallelTerminationStrategy: PID 19905 died... 15:42:49.627175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19905): Terminated: ok {rc=0} 15:42:49.673149 --- ParallelTerminationStrategy: PID 19908 died... 15:42:49.692350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19908): Terminated: ok {rc=0} 15:42:49.738544 --- ParallelTerminationStrategy: PID 19911 died... 15:42:49.758340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19911): Terminated: ok {rc=0} 15:42:49.845856 bus /sierra_9: Setting Powered False 15:42:50.944715 bus /sierra_9: Setting Powered False 15:42:52.060390 bus /sierra_8: Setting Powered False 15:42:53.157486 bus /sierra_8: Setting Powered False 15:42:54.272147 bus /sierra_3: Setting Powered False 15:42:55.369507 bus /sierra_3: Setting Powered False 15:42:56.487296 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:sysmo --------------------------------------------------------------------- 15:42:57.740855 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:42:57.744911 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 15:42:57.765518 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 15:42:57.804138 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 15:42:57.889579 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 15:42:57.909900 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 15:42:57.947865 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 15:42:58.536489 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 15:42:58.586123 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:58.596484 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:42:58.631807 tst cs_paging_gprs_active.py: using LAC 28960 15:42:58.757640 tst cs_paging_gprs_active.py: using RAC 145 15:42:58.882561 tst cs_paging_gprs_active.py: using CellId 28960 15:42:59.009043 tst cs_paging_gprs_active.py: using BVCI 28961 15:42:59.125883 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:59.137019 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:59.147958 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:59.159407 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:59.170851 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:59.182325 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:59.193804 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:59.204940 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:59.216454 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:42:59.331482 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:42:59.450246 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:42:59.666020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:42:59.985619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19917): Launched 15:43:00.261076 run iperf3-srv_10.42.42.10(pid=19918): Launched 15:43:00.379824 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:43:00.594345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:00.915312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19919): Launched 15:43:01.206630 run iperf3-srv_10.42.42.10(pid=19920): Launched 15:43:01.338586 tst cs_paging_gprs_active.py:38: start network... 15:43:01.555589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:02.059073 run create_hlr_db(pid=19921): Launched 15:43:02.218375 bus /sierra_2: Setting Powered False 15:43:03.282047 run create_hlr_db(pid=19921): Terminated: ok {rc=0} 15:43:03.705074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19923): Launched 15:43:03.999983 run osmo-hlr_10.42.42.2(pid=19924): Launched 15:43:04.112649 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:04.629244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19926): Launched 15:43:04.922524 run osmo-stp_10.42.42.5(pid=19927): Launched 15:43:05.034970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:06.512249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19929): Launched 15:43:06.625482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:06.874426 run patchelf(pid=19930): Launched 15:43:07.038745 run osmo-stp_10.42.42.5(pid=19927): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19927)] 15:43:07.164268 run osmo-stp_10.42.42.5(pid=19927): stdout: | (launched: 2022-12-10_15:43:04.869261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:07.291749 run osmo-stp_10.42.42.5(pid=19927): stderr: | [0;m[38;5;43m20221210154305037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154305037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154305037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154305038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154305038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154305038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154305038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:07.419240 run osmo-stp_10.42.42.5(pid=19927): stdout: | (launched: 2022-12-10_15:43:04.869261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:07.540692 run osmo-stp_10.42.42.5(pid=19927): stderr: | [0;m[38;5;43m20221210154305037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154305037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154305037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154305038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154305038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154305038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154305038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:07.684852 run patchelf(pid=19930): Terminating (SIGINT) 15:43:07.851536 run patchelf(pid=19930): Terminated: ok {rc=0} 15:43:07.971948 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19927): Process ended prematurely: osmo-stp_10.42.42.5(pid=19927) [trial-2376↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19927)] [trial-2376↪gprs:sysmo↪cs_paging_gprs_active.py:38] 15:43:07.981367 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 15:43:08.008657 run osmo-hlr_10.42.42.2(pid=19924): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19924)] 15:43:08.056576 run osmo-hlr_10.42.42.2(pid=19924): stdout: | (launched: 2022-12-10_15:43:03.946239) 15:43:08.106017 run osmo-hlr_10.42.42.2(pid=19924): stderr: | [0;m[1;31m20221210154304122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154304122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154304122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154304122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154304122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154304122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154304135 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154304144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154304144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154304144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:08.156014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19917): Terminating (SIGTERM) 15:43:08.196023 run iperf3-srv_10.42.42.10(pid=19918): Terminating (SIGTERM) 15:43:08.235931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19919): Terminating (SIGTERM) 15:43:08.275923 run iperf3-srv_10.42.42.10(pid=19920): Terminating (SIGTERM) 15:43:08.315341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19923): Terminating (SIGTERM) 15:43:08.355155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19926): Terminating (SIGTERM) 15:43:08.394721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19929): Terminating (SIGTERM) 15:43:08.434457 --- ParallelTerminationStrategy: PID 19917 died... 15:43:08.453324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19917): Terminated: ok {rc=0} 15:43:08.497697 --- ParallelTerminationStrategy: PID 19918 died... 15:43:08.516090 run iperf3-srv_10.42.42.10(pid=19918): Terminated {rc=256} 15:43:08.560796 --- ParallelTerminationStrategy: PID 19919 died... 15:43:08.579724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19919): Terminated: ok {rc=0} 15:43:08.624485 --- ParallelTerminationStrategy: PID 19920 died... 15:43:08.643174 run iperf3-srv_10.42.42.10(pid=19920): Terminated {rc=256} 15:43:08.687857 --- ParallelTerminationStrategy: PID 19923 died... 15:43:08.706408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19923): Terminated: ok {rc=0} 15:43:08.750482 --- ParallelTerminationStrategy: PID 19926 died... 15:43:08.769001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19926): Terminated: ok {rc=0} 15:43:08.813042 --- ParallelTerminationStrategy: PID 19929 died... 15:43:08.831474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19929): Terminated: ok {rc=0} 15:43:08.914703 bus /gobi_0: Setting Powered False 15:43:10.013350 bus /gobi_0: Setting Powered False 15:43:11.131491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo iperf3.py ---------------------------------------------- 15:43:12.281388 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:12.292914 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:43:12.329445 tst iperf3.py: using LAC 28961 15:43:12.446794 tst iperf3.py: using RAC 146 15:43:12.564734 tst iperf3.py: using CellId 28961 15:43:12.681250 tst iperf3.py: using BVCI 28962 15:43:12.790031 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:12.800599 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:12.811224 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:12.822574 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:12.833740 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:12.844739 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:12.855818 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:12.866824 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:12.878097 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:12.992797 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:43:13.190947 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:13.485548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19931): Launched 15:43:13.741383 run iperf3-srv_10.42.42.10(pid=19932): Launched 15:43:13.851204 tst iperf3.py:8: start network... 15:43:14.048253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:14.501714 run create_hlr_db(pid=19933): Launched 15:43:14.612547 bus /gobi_6: Setting Powered False 15:43:15.672186 run create_hlr_db(pid=19933): Terminated: ok {rc=0} 15:43:16.124472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19935): Launched 15:43:16.444199 run osmo-hlr_10.42.42.2(pid=19936): Launched 15:43:16.677040 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:17.355117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19938): Launched 15:43:17.652174 run osmo-stp_10.42.42.5(pid=19939): Launched 15:43:17.762989 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:18.269207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19941): Launched 15:43:18.381787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:18.629770 run patchelf(pid=19942): Launched 15:43:18.792768 run osmo-stp_10.42.42.5(pid=19939): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19939)] 15:43:18.917591 run osmo-stp_10.42.42.5(pid=19939): stdout: | (launched: 2022-12-10_15:43:17.598860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:19.044180 run osmo-stp_10.42.42.5(pid=19939): stderr: | [0;m[38;5;43m20221210154317769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154317769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154317769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154317770 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154317770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154317770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154317770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:19.170406 run osmo-stp_10.42.42.5(pid=19939): stdout: | (launched: 2022-12-10_15:43:17.598860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:19.291041 run osmo-stp_10.42.42.5(pid=19939): stderr: | [0;m[38;5;43m20221210154317769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154317769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154317769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154317770 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154317770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154317770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154317770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:19.434097 run patchelf(pid=19942): Terminating (SIGINT) 15:43:19.599484 run patchelf(pid=19942): Terminated: ok {rc=0} 15:43:19.719228 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19939): Process ended prematurely: osmo-stp_10.42.42.5(pid=19939) [trial-2376↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19939)] [trial-2376↪gprs:sysmo↪iperf3.py:8] 15:43:19.728406 tst iperf3.py:8: Test FAILED (7.5 sec) 15:43:19.755491 run osmo-hlr_10.42.42.2(pid=19936): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19936)] 15:43:19.803172 run osmo-hlr_10.42.42.2(pid=19936): stdout: | (launched: 2022-12-10_15:43:16.382788) 15:43:19.852025 run osmo-hlr_10.42.42.2(pid=19936): stderr: | [0;m[1;31m20221210154316583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154316583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154316583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154316583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154316583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154316583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154316599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154316619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154316619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154316619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:19.901186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19931): Terminating (SIGTERM) 15:43:19.940469 run iperf3-srv_10.42.42.10(pid=19932): Terminating (SIGTERM) 15:43:19.979904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19935): Terminating (SIGTERM) 15:43:20.019595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19938): Terminating (SIGTERM) 15:43:20.058759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19941): Terminating (SIGTERM) 15:43:20.098289 --- ParallelTerminationStrategy: PID 19931 died... 15:43:20.116631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19931): Terminated: ok {rc=0} 15:43:20.160240 --- ParallelTerminationStrategy: PID 19932 died... 15:43:20.178585 run iperf3-srv_10.42.42.10(pid=19932): Terminated {rc=256} 15:43:20.222002 --- ParallelTerminationStrategy: PID 19935 died... 15:43:20.240059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19935): Terminated: ok {rc=0} 15:43:20.283714 --- ParallelTerminationStrategy: PID 19938 died... 15:43:20.302064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19938): Terminated: ok {rc=0} 15:43:20.345854 --- ParallelTerminationStrategy: PID 19941 died... 15:43:20.364357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19941): Terminated: ok {rc=0} 15:43:20.449767 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo iperf3m4.py ---------------------------------------------- 15:43:21.597092 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:21.607904 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:43:21.640746 tst iperf3m4.py: using LAC 28962 15:43:21.764673 tst iperf3m4.py: using RAC 147 15:43:21.889391 tst iperf3m4.py: using CellId 28962 15:43:22.013425 tst iperf3m4.py: using BVCI 28963 15:43:22.129507 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:22.140416 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:22.151605 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:22.162417 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:22.173106 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:22.183777 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:22.194767 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:22.205532 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:22.216390 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:22.331324 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:22.451516 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:22.565688 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:22.679219 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:43:22.876854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:23.174310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19943): Launched 15:43:23.430690 run iperf3-srv_10.42.42.10(pid=19944): Launched 15:43:23.540880 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:43:23.738383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:24.034605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19945): Launched 15:43:24.290698 run iperf3-srv_10.42.42.10(pid=19946): Launched 15:43:24.400630 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:43:24.597897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:24.893155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19947): Launched 15:43:25.148631 run iperf3-srv_10.42.42.10(pid=19948): Launched 15:43:25.258260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:43:25.454085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:25.748282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19949): Launched 15:43:26.019721 run iperf3-srv_10.42.42.10(pid=19950): Launched 15:43:26.130300 tst iperf3m4.py:8: start network... 15:43:26.327108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:26.783036 run create_hlr_db(pid=19951): Launched 15:43:26.896104 bus /gobi_6: Setting Powered False 15:43:27.955038 run create_hlr_db(pid=19951): Terminated: ok {rc=0} 15:43:28.390029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19953): Launched 15:43:28.705373 run osmo-hlr_10.42.42.2(pid=19954): Launched 15:43:28.826497 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:29.374593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19956): Launched 15:43:29.689369 run osmo-stp_10.42.42.5(pid=19957): Launched 15:43:29.809921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:30.355795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19959): Launched 15:43:30.477288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:30.743992 run patchelf(pid=19960): Launched 15:43:30.945403 run osmo-stp_10.42.42.5(pid=19957): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19957)] 15:43:31.083389 run osmo-stp_10.42.42.5(pid=19957): stdout: | (launched: 2022-12-10_15:43:29.632317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:31.225231 run osmo-stp_10.42.42.5(pid=19957): stderr: | [0;m[38;5;43m20221210154329820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154329820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154329820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154329821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154329821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154329821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154329821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:31.386183 run osmo-stp_10.42.42.5(pid=19957): stdout: | (launched: 2022-12-10_15:43:29.632317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:31.517389 run osmo-stp_10.42.42.5(pid=19957): stderr: | [0;m[38;5;43m20221210154329820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154329820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154329820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154329821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154329821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154329821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154329821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:31.667856 run patchelf(pid=19960): Terminating (SIGINT) 15:43:31.839139 run patchelf(pid=19960): Terminated: ok {rc=0} 15:43:31.963969 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19957): Process ended prematurely: osmo-stp_10.42.42.5(pid=19957) [trial-2376↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19957)] [trial-2376↪gprs:sysmo↪iperf3m4.py:8] 15:43:31.974531 tst iperf3m4.py:8: Test FAILED (10.4 sec) 15:43:32.005760 run osmo-hlr_10.42.42.2(pid=19954): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19954)] 15:43:32.057397 run osmo-hlr_10.42.42.2(pid=19954): stdout: | (launched: 2022-12-10_15:43:28.648309) 15:43:32.111128 run osmo-hlr_10.42.42.2(pid=19954): stderr: | [0;m[1;31m20221210154328845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154328845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154328845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154328845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154328845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154328845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154328856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154328866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154328866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154328866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:32.164125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19943): Terminating (SIGTERM) 15:43:32.206704 run iperf3-srv_10.42.42.10(pid=19944): Terminating (SIGTERM) 15:43:32.248455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19945): Terminating (SIGTERM) 15:43:32.289129 run iperf3-srv_10.42.42.10(pid=19946): Terminating (SIGTERM) 15:43:32.329198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19947): Terminating (SIGTERM) 15:43:32.369582 run iperf3-srv_10.42.42.10(pid=19948): Terminating (SIGTERM) 15:43:32.410133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19949): Terminating (SIGTERM) 15:43:32.452129 run iperf3-srv_10.42.42.10(pid=19950): Terminating (SIGTERM) 15:43:32.492257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19953): Terminating (SIGTERM) 15:43:32.532529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19956): Terminating (SIGTERM) 15:43:32.573123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19959): Terminating (SIGTERM) 15:43:32.613656 --- ParallelTerminationStrategy: PID 19943 died... 15:43:32.632393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19943): Terminated: ok {rc=0} 15:43:32.677390 --- ParallelTerminationStrategy: PID 19944 died... 15:43:32.696004 run iperf3-srv_10.42.42.10(pid=19944): Terminated {rc=256} 15:43:32.740435 --- ParallelTerminationStrategy: PID 19945 died... 15:43:32.759062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19945): Terminated: ok {rc=0} 15:43:32.803921 --- ParallelTerminationStrategy: PID 19946 died... 15:43:32.822522 run iperf3-srv_10.42.42.10(pid=19946): Terminated {rc=256} 15:43:32.867157 --- ParallelTerminationStrategy: PID 19947 died... 15:43:32.885846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19947): Terminated: ok {rc=0} 15:43:32.930615 --- ParallelTerminationStrategy: PID 19948 died... 15:43:32.949273 run iperf3-srv_10.42.42.10(pid=19948): Terminated {rc=256} 15:43:32.993734 --- ParallelTerminationStrategy: PID 19949 died... 15:43:33.012340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19949): Terminated: ok {rc=0} 15:43:33.056907 --- ParallelTerminationStrategy: PID 19950 died... 15:43:33.075582 run iperf3-srv_10.42.42.10(pid=19950): Terminated {rc=256} 15:43:33.120287 --- ParallelTerminationStrategy: PID 19953 died... 15:43:33.139091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19953): Terminated: ok {rc=0} 15:43:33.183898 --- ParallelTerminationStrategy: PID 19956 died... 15:43:33.202714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19956): Terminated: ok {rc=0} 15:43:33.247510 --- ParallelTerminationStrategy: PID 19959 died... 15:43:33.266232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19959): Terminated: ok {rc=0} 15:43:33.353233 bus /gobi_4: Setting Powered False 15:43:34.452825 bus /gobi_4: Setting Powered False 15:43:35.568759 bus /gobi_1: Setting Powered False 15:43:36.668247 bus /gobi_1: Setting Powered False 15:43:37.784281 bus /gobi_0: Setting Powered False 15:43:38.882541 bus /gobi_0: Setting Powered False 15:43:39.998805 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo ping.py ---------------------------------------------- 15:43:41.100639 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:41.111588 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:43:41.151916 tst ping.py: using LAC 28963 15:43:41.267693 tst ping.py: using RAC 148 15:43:41.392451 tst ping.py: using CellId 28963 15:43:41.514859 tst ping.py: using BVCI 28964 15:43:41.629307 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:41.640402 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:41.651528 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:41.662756 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:41.674099 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:41.685189 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:41.696332 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:41.707495 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:41.824516 tst ping.py:19: start network... 15:43:42.018958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:42.469385 run create_hlr_db(pid=19962): Launched 15:43:42.579846 bus /gobi_6: Setting Powered False 15:43:43.637581 run create_hlr_db(pid=19962): Terminated: ok {rc=0} 15:43:44.063097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19964): Launched 15:43:44.375093 run osmo-hlr_10.42.42.2(pid=19965): Launched 15:43:44.493370 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:45.028350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19967): Launched 15:43:45.337562 run osmo-stp_10.42.42.5(pid=19968): Launched 15:43:45.455158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:46.003482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19970): Launched 15:43:46.137569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:46.396660 run patchelf(pid=19971): Launched 15:43:46.578987 run osmo-stp_10.42.42.5(pid=19968): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19968)] 15:43:46.707532 run osmo-stp_10.42.42.5(pid=19968): stdout: | (launched: 2022-12-10_15:43:45.281456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:46.836670 run osmo-stp_10.42.42.5(pid=19968): stderr: | [0;m[38;5;43m20221210154345473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154345473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154345473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154345473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154345474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154345474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154345474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:46.973276 run osmo-stp_10.42.42.5(pid=19968): stdout: | (launched: 2022-12-10_15:43:45.281456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:47.104659 run osmo-stp_10.42.42.5(pid=19968): stderr: | [0;m[38;5;43m20221210154345473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154345473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154345473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154345473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154345474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154345474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154345474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:47.257874 run patchelf(pid=19971): Terminating (SIGINT) 15:43:47.432154 run patchelf(pid=19971): Terminated: ok {rc=0} 15:43:47.558371 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19968): Process ended prematurely: osmo-stp_10.42.42.5(pid=19968) [trial-2376↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19968)] [trial-2376↪gprs:sysmo↪ping.py:22] 15:43:47.567751 tst ping.py:22: Test FAILED (6.5 sec) 15:43:47.596136 run osmo-hlr_10.42.42.2(pid=19965): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19965)] 15:43:47.646718 run osmo-hlr_10.42.42.2(pid=19965): stdout: | (launched: 2022-12-10_15:43:44.318729) 15:43:47.699167 run osmo-hlr_10.42.42.2(pid=19965): stderr: | [0;m[1;31m20221210154344517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154344517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154344517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154344517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154344517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154344517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154344532 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154344543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154344543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154344543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:47.751725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19964): Terminating (SIGTERM) 15:43:47.794153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19967): Terminating (SIGTERM) 15:43:47.836204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19970): Terminating (SIGTERM) 15:43:47.878467 --- ParallelTerminationStrategy: PID 19964 died... 15:43:47.898830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19964): Terminated: ok {rc=0} 15:43:47.946005 --- ParallelTerminationStrategy: PID 19967 died... 15:43:47.965845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19967): Terminated: ok {rc=0} 15:43:48.012408 --- ParallelTerminationStrategy: PID 19970 died... 15:43:48.032110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19970): Terminated: ok {rc=0} 15:43:48.120230 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 15:43:49.207811 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:49.219363 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:43:49.255425 tst ping_idle_ping.py: using LAC 28964 15:43:49.370423 tst ping_idle_ping.py: using RAC 149 15:43:49.484533 tst ping_idle_ping.py: using CellId 28964 15:43:49.598304 tst ping_idle_ping.py: using BVCI 28965 15:43:49.703240 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:49.713727 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:49.724047 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:49.734586 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:49.744941 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:49.755096 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:49.765886 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:49.776425 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:49.899179 tst ping_idle_ping.py:24: start network... 15:43:50.109277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:50.591923 run create_hlr_db(pid=19972): Launched 15:43:50.717716 bus /gobi_6: Setting Powered False 15:43:51.779310 run create_hlr_db(pid=19972): Terminated: ok {rc=0} 15:43:52.195403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19974): Launched 15:43:52.484301 run osmo-hlr_10.42.42.2(pid=19975): Launched 15:43:52.594745 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:53.107119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19977): Launched 15:43:53.394997 run osmo-stp_10.42.42.5(pid=19978): Launched 15:43:53.504510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:54.005165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19980): Launched 15:43:54.116461 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:54.361344 run patchelf(pid=19981): Launched 15:43:54.521838 run osmo-stp_10.42.42.5(pid=19978): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19978)] 15:43:54.645091 run osmo-stp_10.42.42.5(pid=19978): stdout: | (launched: 2022-12-10_15:43:53.342389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:54.770325 run osmo-stp_10.42.42.5(pid=19978): stderr: | [0;m[38;5;43m20221210154353512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154353512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154353512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154353513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154353513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154353513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154353513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:54.895323 run osmo-stp_10.42.42.5(pid=19978): stdout: | (launched: 2022-12-10_15:43:53.342389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:55.014597 run osmo-stp_10.42.42.5(pid=19978): stderr: | [0;m[38;5;43m20221210154353512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154353512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154353512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154353513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154353513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154353513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154353513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:55.155514 run patchelf(pid=19981): Terminating (SIGINT) 15:43:55.318424 run patchelf(pid=19981): Terminated: ok {rc=0} 15:43:55.435784 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19978): Process ended prematurely: osmo-stp_10.42.42.5(pid=19978) [trial-2376↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19978)] [trial-2376↪gprs:sysmo↪ping_idle_ping.py:27] 15:43:55.444524 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 15:43:55.471264 run osmo-hlr_10.42.42.2(pid=19975): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19975)] 15:43:55.518375 run osmo-hlr_10.42.42.2(pid=19975): stdout: | (launched: 2022-12-10_15:43:52.431799) 15:43:55.567270 run osmo-hlr_10.42.42.2(pid=19975): stderr: | [0;m[1;31m20221210154352606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154352606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154352606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154352606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154352606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154352606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154352618 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154352626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154352627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154352627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:55.616538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19974): Terminating (SIGTERM) 15:43:55.656028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19977): Terminating (SIGTERM) 15:43:55.695057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19980): Terminating (SIGTERM) 15:43:55.735031 --- ParallelTerminationStrategy: PID 19974 died... 15:43:55.753928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19974): Terminated: ok {rc=0} 15:43:55.798365 --- ParallelTerminationStrategy: PID 19977 died... 15:43:55.816773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19977): Terminated: ok {rc=0} 15:43:55.860936 --- ParallelTerminationStrategy: PID 19980 died... 15:43:55.879777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19980): Terminated: ok {rc=0} 15:43:55.966039 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 15:43:57.248717 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:43:57.254258 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 15:43:57.275232 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 15:43:57.313458 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 15:43:57.397853 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 15:43:57.418239 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 15:43:57.456938 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 15:43:58.048074 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 15:43:58.100713 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:58.112120 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:43:58.149294 tst cs_paging_gprs_active.py: using LAC 28965 15:43:58.273003 tst cs_paging_gprs_active.py: using RAC 150 15:43:58.397497 tst cs_paging_gprs_active.py: using CellId 28965 15:43:58.534838 tst cs_paging_gprs_active.py: using BVCI 28966 15:43:58.650848 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:58.662150 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:58.673184 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:58.684198 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:58.695100 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:58.705982 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:58.717072 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:58.727900 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:58.739120 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:43:58.855752 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:43:58.973609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:43:59.189105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:59.507614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19987): Launched 15:43:59.783213 run iperf3-srv_10.42.42.10(pid=19988): Launched 15:43:59.906650 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:44:00.121764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:00.440803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19989): Launched 15:44:00.716819 run iperf3-srv_10.42.42.10(pid=19990): Launched 15:44:00.836311 tst cs_paging_gprs_active.py:38: start network... 15:44:01.057874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:01.563241 run create_hlr_db(pid=19991): Launched 15:44:01.723764 bus /gobi_6: Setting Powered False 15:44:02.785687 run create_hlr_db(pid=19991): Terminated: ok {rc=0} 15:44:03.228224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19993): Launched 15:44:03.543674 run osmo-hlr_10.42.42.2(pid=19994): Launched 15:44:03.663882 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:04.213418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19996): Launched 15:44:04.531499 run osmo-stp_10.42.42.5(pid=19997): Launched 15:44:04.652460 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:05.199076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19999): Launched 15:44:05.319979 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:05.586357 run patchelf(pid=20000): Launched 15:44:05.762275 run osmo-stp_10.42.42.5(pid=19997): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19997)] 15:44:05.897195 run osmo-stp_10.42.42.5(pid=19997): stdout: | (launched: 2022-12-10_15:44:04.474097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:06.033617 run osmo-stp_10.42.42.5(pid=19997): stderr: | [0;m[38;5;43m20221210154404664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154404664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154404664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154404664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154404666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154404666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154404666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:06.170193 run osmo-stp_10.42.42.5(pid=19997): stdout: | (launched: 2022-12-10_15:44:04.474097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:06.300752 run osmo-stp_10.42.42.5(pid=19997): stderr: | [0;m[38;5;43m20221210154404664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154404664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154404664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154404664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154404666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154404666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154404666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:06.455667 run patchelf(pid=20000): Terminating (SIGINT) 15:44:06.633766 run patchelf(pid=20000): Terminated: ok {rc=0} 15:44:06.762020 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19997): Process ended prematurely: osmo-stp_10.42.42.5(pid=19997) [trial-2376↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19997)] [trial-2376↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 15:44:06.772044 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 15:44:06.800777 run osmo-hlr_10.42.42.2(pid=19994): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19994)] 15:44:06.850808 run osmo-hlr_10.42.42.2(pid=19994): stdout: | (launched: 2022-12-10_15:44:03.486653) 15:44:06.902976 run osmo-hlr_10.42.42.2(pid=19994): stderr: | [0;m[1;31m20221210154403687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154403687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154403687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154403687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154403687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154403687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154403700 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154403711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154403711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154403711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:06.955154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19987): Terminating (SIGTERM) 15:44:06.997175 run iperf3-srv_10.42.42.10(pid=19988): Terminating (SIGTERM) 15:44:07.039110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19989): Terminating (SIGTERM) 15:44:07.081402 run iperf3-srv_10.42.42.10(pid=19990): Terminating (SIGTERM) 15:44:07.123245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19993): Terminating (SIGTERM) 15:44:07.165355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19996): Terminating (SIGTERM) 15:44:07.207274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19999): Terminating (SIGTERM) 15:44:07.249512 --- ParallelTerminationStrategy: PID 19987 died... 15:44:07.269628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19987): Terminated: ok {rc=0} 15:44:07.316300 --- ParallelTerminationStrategy: PID 19988 died... 15:44:07.335792 run iperf3-srv_10.42.42.10(pid=19988): Terminated {rc=256} 15:44:07.382088 --- ParallelTerminationStrategy: PID 19989 died... 15:44:07.401778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19989): Terminated: ok {rc=0} 15:44:07.447908 --- ParallelTerminationStrategy: PID 19990 died... 15:44:07.467308 run iperf3-srv_10.42.42.10(pid=19990): Terminated {rc=256} 15:44:07.513554 --- ParallelTerminationStrategy: PID 19993 died... 15:44:07.533159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19993): Terminated: ok {rc=0} 15:44:07.579282 --- ParallelTerminationStrategy: PID 19996 died... 15:44:07.598918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19996): Terminated: ok {rc=0} 15:44:07.645213 --- ParallelTerminationStrategy: PID 19999 died... 15:44:07.664720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19999): Terminated: ok {rc=0} 15:44:07.752204 bus /gobi_0: Setting Powered False 15:44:08.852595 bus /gobi_0: Setting Powered False 15:44:09.967506 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 15:44:11.111179 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:11.122694 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:44:11.159676 tst iperf3.py: using LAC 28966 15:44:11.277234 tst iperf3.py: using RAC 151 15:44:11.393860 tst iperf3.py: using CellId 28966 15:44:11.513447 tst iperf3.py: using BVCI 28967 15:44:11.630242 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:11.641611 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:11.652612 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:11.663874 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:11.675346 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:11.686528 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:11.698245 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:11.709411 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:11.720637 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:11.836173 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:44:12.034607 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:12.329341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20001): Launched 15:44:12.585202 run iperf3-srv_10.42.42.10(pid=20002): Launched 15:44:12.694941 tst iperf3.py:8: start network... 15:44:12.891375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:13.345784 run create_hlr_db(pid=20003): Launched 15:44:13.456912 bus /gobi_6: Setting Powered False 15:44:14.516283 run create_hlr_db(pid=20003): Terminated: ok {rc=0} 15:44:14.949116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20005): Launched 15:44:15.265783 run osmo-hlr_10.42.42.2(pid=20006): Launched 15:44:15.385746 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:15.955549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20008): Launched 15:44:16.343677 run osmo-stp_10.42.42.5(pid=20009): Launched 15:44:16.525299 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:17.209480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20011): Launched 15:44:17.337155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:17.604262 run patchelf(pid=20012): Launched 15:44:17.780257 run osmo-stp_10.42.42.5(pid=20009): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20009)] 15:44:17.915133 run osmo-stp_10.42.42.5(pid=20009): stdout: | (launched: 2022-12-10_15:44:16.283032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:18.051784 run osmo-stp_10.42.42.5(pid=20009): stderr: | [0;m[38;5;43m20221210154416606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154416606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154416606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154416607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154416607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154416607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154416607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:18.187766 run osmo-stp_10.42.42.5(pid=20009): stdout: | (launched: 2022-12-10_15:44:16.283032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:18.317933 run osmo-stp_10.42.42.5(pid=20009): stderr: | [0;m[38;5;43m20221210154416606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154416606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154416606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154416607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154416607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154416607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154416607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:18.472132 run patchelf(pid=20012): Terminating (SIGINT) 15:44:18.649858 run patchelf(pid=20012): Terminated: ok {rc=0} 15:44:18.778401 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20009): Process ended prematurely: osmo-stp_10.42.42.5(pid=20009) [trial-2376↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20009)] [trial-2376↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 15:44:18.788360 tst iperf3.py:8: Test FAILED (7.7 sec) 15:44:18.817043 run osmo-hlr_10.42.42.2(pid=20006): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20006)] 15:44:18.867151 run osmo-hlr_10.42.42.2(pid=20006): stdout: | (launched: 2022-12-10_15:44:15.208903) 15:44:18.918867 run osmo-hlr_10.42.42.2(pid=20006): stderr: | [0;m[1;31m20221210154415409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154415409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154415409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154415409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154415409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154415409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154415422 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154415431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154415431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154415432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:18.970769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20001): Terminating (SIGTERM) 15:44:19.012677 run iperf3-srv_10.42.42.10(pid=20002): Terminating (SIGTERM) 15:44:19.054597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20005): Terminating (SIGTERM) 15:44:19.096599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20008): Terminating (SIGTERM) 15:44:19.138397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20011): Terminating (SIGTERM) 15:44:19.180530 --- ParallelTerminationStrategy: PID 20001 died... 15:44:19.200673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20001): Terminated: ok {rc=0} 15:44:19.247517 --- ParallelTerminationStrategy: PID 20002 died... 15:44:19.267101 run iperf3-srv_10.42.42.10(pid=20002): Terminated {rc=256} 15:44:19.312892 --- ParallelTerminationStrategy: PID 20005 died... 15:44:19.332619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20005): Terminated: ok {rc=0} 15:44:19.378773 --- ParallelTerminationStrategy: PID 20008 died... 15:44:19.398432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20008): Terminated: ok {rc=0} 15:44:19.444497 --- ParallelTerminationStrategy: PID 20011 died... 15:44:19.464052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20011): Terminated: ok {rc=0} 15:44:19.551346 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 15:44:20.700355 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:20.711998 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:44:20.749038 tst iperf3m4.py: using LAC 28967 15:44:20.871957 tst iperf3m4.py: using RAC 152 15:44:20.994547 tst iperf3m4.py: using CellId 28967 15:44:21.116904 tst iperf3m4.py: using BVCI 28968 15:44:21.231479 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:21.242668 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:21.253740 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:21.264657 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:21.275584 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:21.286531 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:21.297626 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:21.308440 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:21.319880 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:21.435402 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:21.551215 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:21.664793 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:21.778496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:44:21.977427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:22.274850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20013): Launched 15:44:22.531589 run iperf3-srv_10.42.42.10(pid=20014): Launched 15:44:22.641873 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:44:22.839139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:23.134104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20015): Launched 15:44:23.389805 run iperf3-srv_10.42.42.10(pid=20016): Launched 15:44:23.500713 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:44:23.698490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:23.995206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20017): Launched 15:44:24.251790 run iperf3-srv_10.42.42.10(pid=20018): Launched 15:44:24.362627 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:44:24.560870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:24.857366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20019): Launched 15:44:25.113900 run iperf3-srv_10.42.42.10(pid=20020): Launched 15:44:25.224205 tst iperf3m4.py:8: start network... 15:44:25.421850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:25.878284 run create_hlr_db(pid=20021): Launched 15:44:25.995744 bus /gobi_6: Setting Powered False 15:44:27.055019 run create_hlr_db(pid=20021): Terminated: ok {rc=0} 15:44:27.467230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20023): Launched 15:44:27.761105 run osmo-hlr_10.42.42.2(pid=20024): Launched 15:44:27.872780 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:28.391172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20026): Launched 15:44:28.685638 run osmo-stp_10.42.42.5(pid=20027): Launched 15:44:28.798664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:29.307792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20029): Launched 15:44:29.420228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:29.669611 run patchelf(pid=20030): Launched 15:44:29.846958 run osmo-stp_10.42.42.5(pid=20027): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20027)] 15:44:29.981437 run osmo-stp_10.42.42.5(pid=20027): stdout: | (launched: 2022-12-10_15:44:28.631810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:30.117976 run osmo-stp_10.42.42.5(pid=20027): stderr: | [0;m[38;5;43m20221210154428796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154428797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154428797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154428797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154428798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154428798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154428798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:30.254374 run osmo-stp_10.42.42.5(pid=20027): stdout: | (launched: 2022-12-10_15:44:28.631810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:30.384809 run osmo-stp_10.42.42.5(pid=20027): stderr: | [0;m[38;5;43m20221210154428796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154428797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154428797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154428797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154428798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154428798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154428798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:30.539591 run patchelf(pid=20030): Terminating (SIGINT) 15:44:30.718440 run patchelf(pid=20030): Terminated: ok {rc=0} 15:44:30.852792 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20027): Process ended prematurely: osmo-stp_10.42.42.5(pid=20027) [trial-2376↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20027)] [trial-2376↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 15:44:30.863482 tst iperf3m4.py:8: Test FAILED (10.2 sec) 15:44:30.893628 run osmo-hlr_10.42.42.2(pid=20024): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20024)] 15:44:30.946767 run osmo-hlr_10.42.42.2(pid=20024): stdout: | (launched: 2022-12-10_15:44:27.707660) 15:44:30.998537 run osmo-hlr_10.42.42.2(pid=20024): stderr: | [0;m[1;31m20221210154427881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154427881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154427881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154427881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154427881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154427881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154427892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154427901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154427901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154427901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:31.051053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20013): Terminating (SIGTERM) 15:44:31.094105 run iperf3-srv_10.42.42.10(pid=20014): Terminating (SIGTERM) 15:44:31.139497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20015): Terminating (SIGTERM) 15:44:31.183004 run iperf3-srv_10.42.42.10(pid=20016): Terminating (SIGTERM) 15:44:31.228171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20017): Terminating (SIGTERM) 15:44:31.270819 run iperf3-srv_10.42.42.10(pid=20018): Terminating (SIGTERM) 15:44:31.316108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20019): Terminating (SIGTERM) 15:44:31.358836 run iperf3-srv_10.42.42.10(pid=20020): Terminating (SIGTERM) 15:44:31.404089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20023): Terminating (SIGTERM) 15:44:31.447091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20026): Terminating (SIGTERM) 15:44:31.490880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20029): Terminating (SIGTERM) 15:44:31.535612 --- ParallelTerminationStrategy: PID 20013 died... 15:44:31.555691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20013): Terminated: ok {rc=0} 15:44:31.605746 --- ParallelTerminationStrategy: PID 20014 died... 15:44:31.633309 run iperf3-srv_10.42.42.10(pid=20014): Terminated {rc=256} 15:44:31.681039 --- ParallelTerminationStrategy: PID 20015 died... 15:44:31.700685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20015): Terminated: ok {rc=0} 15:44:31.748454 --- ParallelTerminationStrategy: PID 20016 died... 15:44:31.767986 run iperf3-srv_10.42.42.10(pid=20016): Terminated {rc=256} 15:44:31.816058 --- ParallelTerminationStrategy: PID 20017 died... 15:44:31.835751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20017): Terminated: ok {rc=0} 15:44:31.885404 --- ParallelTerminationStrategy: PID 20018 died... 15:44:31.905165 run iperf3-srv_10.42.42.10(pid=20018): Terminated {rc=256} 15:44:31.952987 --- ParallelTerminationStrategy: PID 20019 died... 15:44:31.972718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20019): Terminated: ok {rc=0} 15:44:32.021281 --- ParallelTerminationStrategy: PID 20020 died... 15:44:32.041201 run iperf3-srv_10.42.42.10(pid=20020): Terminated {rc=256} 15:44:32.090370 --- ParallelTerminationStrategy: PID 20023 died... 15:44:32.109920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20023): Terminated: ok {rc=0} 15:44:32.157877 --- ParallelTerminationStrategy: PID 20026 died... 15:44:32.177377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20026): Terminated: ok {rc=0} 15:44:32.224893 --- ParallelTerminationStrategy: PID 20029 died... 15:44:32.244858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20029): Terminated: ok {rc=0} 15:44:32.332499 bus /gobi_4: Setting Powered False 15:44:33.429828 bus /gobi_4: Setting Powered False 15:44:34.545896 bus /gobi_1: Setting Powered False 15:44:35.645827 bus /gobi_1: Setting Powered False 15:44:36.760060 bus /gobi_0: Setting Powered False 15:44:37.858072 bus /gobi_0: Setting Powered False 15:44:38.976269 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 15:44:40.078829 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:40.090289 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:44:40.129389 tst ping.py: using LAC 28968 15:44:40.244785 tst ping.py: using RAC 153 15:44:40.371734 tst ping.py: using CellId 28968 15:44:40.497752 tst ping.py: using BVCI 28969 15:44:40.610289 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:40.621680 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:40.632941 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:40.644113 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:40.655120 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:40.666198 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:40.677887 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:40.688791 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:40.807208 tst ping.py:19: start network... 15:44:41.018300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:41.500063 run create_hlr_db(pid=20031): Launched 15:44:41.626866 bus /gobi_6: Setting Powered False 15:44:42.690034 run create_hlr_db(pid=20031): Terminated: ok {rc=0} 15:44:43.126331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20033): Launched 15:44:43.436539 run osmo-hlr_10.42.42.2(pid=20034): Launched 15:44:43.554488 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:44.094865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20036): Launched 15:44:44.403736 run osmo-stp_10.42.42.5(pid=20037): Launched 15:44:44.521508 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:45.057681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20039): Launched 15:44:45.175756 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:45.437360 run patchelf(pid=20040): Launched 15:44:45.610283 run osmo-stp_10.42.42.5(pid=20037): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20037)] 15:44:45.741947 run osmo-stp_10.42.42.5(pid=20037): stdout: | (launched: 2022-12-10_15:44:44.347860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:45.901590 run osmo-stp_10.42.42.5(pid=20037): stderr: | [0;m[38;5;43m20221210154444540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154444540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154444541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154444541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154444542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154444542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154444542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:46.034277 run osmo-stp_10.42.42.5(pid=20037): stdout: | (launched: 2022-12-10_15:44:44.347860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:46.159011 run osmo-stp_10.42.42.5(pid=20037): stderr: | [0;m[38;5;43m20221210154444540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154444540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154444541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154444541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154444542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154444542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154444542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:46.305684 run patchelf(pid=20040): Terminating (SIGINT) 15:44:46.475627 run patchelf(pid=20040): Terminated: ok {rc=0} 15:44:46.597773 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20037): Process ended prematurely: osmo-stp_10.42.42.5(pid=20037) [trial-2376↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20037)] [trial-2376↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 15:44:46.607514 tst ping.py:22: Test FAILED (6.5 sec) 15:44:46.637836 run osmo-hlr_10.42.42.2(pid=20034): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20034)] 15:44:46.689583 run osmo-hlr_10.42.42.2(pid=20034): stdout: | (launched: 2022-12-10_15:44:43.380170) 15:44:46.741281 run osmo-hlr_10.42.42.2(pid=20034): stderr: | [0;m[1;31m20221210154443582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154443582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154443582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154443582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154443582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154443582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154443594 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154443604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154443604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154443604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:46.793784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20033): Terminating (SIGTERM) 15:44:46.837502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20036): Terminating (SIGTERM) 15:44:46.882618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20039): Terminating (SIGTERM) 15:44:46.927253 --- ParallelTerminationStrategy: PID 20033 died... 15:44:46.947382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20033): Terminated: ok {rc=0} 15:44:46.996432 --- ParallelTerminationStrategy: PID 20036 died... 15:44:47.016066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20036): Terminated: ok {rc=0} 15:44:47.063510 --- ParallelTerminationStrategy: PID 20039 died... 15:44:47.084079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20039): Terminated: ok {rc=0} 15:44:47.173073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 15:44:48.261796 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:48.273596 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:44:48.312553 tst ping_idle_ping.py: using LAC 28969 15:44:48.429318 tst ping_idle_ping.py: using RAC 154 15:44:48.553047 tst ping_idle_ping.py: using CellId 28969 15:44:48.675725 tst ping_idle_ping.py: using BVCI 28970 15:44:48.789585 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:48.800675 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:48.812045 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:48.823111 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:48.834168 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:48.845068 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:48.856118 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:48.867466 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:48.989529 tst ping_idle_ping.py:24: start network... 15:44:49.198786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:49.678648 run create_hlr_db(pid=20041): Launched 15:44:49.804360 bus /gobi_6: Setting Powered False 15:44:50.867203 run create_hlr_db(pid=20041): Terminated: ok {rc=0} 15:44:51.283566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20043): Launched 15:44:51.572752 run osmo-hlr_10.42.42.2(pid=20044): Launched 15:44:51.683303 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:52.179934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20046): Launched 15:44:52.467729 run osmo-stp_10.42.42.5(pid=20047): Launched 15:44:52.578576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:53.081635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20049): Launched 15:44:53.192889 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:53.437280 run patchelf(pid=20050): Launched 15:44:53.598428 run osmo-stp_10.42.42.5(pid=20047): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20047)] 15:44:53.721660 run osmo-stp_10.42.42.5(pid=20047): stdout: | (launched: 2022-12-10_15:44:52.415340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:53.845898 run osmo-stp_10.42.42.5(pid=20047): stderr: | [0;m[38;5;43m20221210154452582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154452582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154452582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154452583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154452583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154452583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154452583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:53.970013 run osmo-stp_10.42.42.5(pid=20047): stdout: | (launched: 2022-12-10_15:44:52.415340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:54.089177 run osmo-stp_10.42.42.5(pid=20047): stderr: | [0;m[38;5;43m20221210154452582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154452582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154452582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154452583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154452583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154452583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154452583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:54.229709 run patchelf(pid=20050): Terminating (SIGINT) 15:44:54.392565 run patchelf(pid=20050): Terminated: ok {rc=0} 15:44:54.510286 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20047): Process ended prematurely: osmo-stp_10.42.42.5(pid=20047) [trial-2376↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20047)] [trial-2376↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 15:44:54.519136 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 15:44:54.545646 run osmo-hlr_10.42.42.2(pid=20044): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20044)] 15:44:54.592662 run osmo-hlr_10.42.42.2(pid=20044): stdout: | (launched: 2022-12-10_15:44:51.520211) 15:44:54.641449 run osmo-hlr_10.42.42.2(pid=20044): stderr: | [0;m[1;31m20221210154451696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154451696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154451696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154451696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154451696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154451696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154451709 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154451717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154451717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154451717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:54.690555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20043): Terminating (SIGTERM) 15:44:54.730033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20046): Terminating (SIGTERM) 15:44:54.769954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20049): Terminating (SIGTERM) 15:44:54.809841 --- ParallelTerminationStrategy: PID 20043 died... 15:44:54.828782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20043): Terminated: ok {rc=0} 15:44:54.872879 --- ParallelTerminationStrategy: PID 20046 died... 15:44:54.891233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20046): Terminated: ok {rc=0} 15:44:54.935206 --- ParallelTerminationStrategy: PID 20049 died... 15:44:54.953616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20049): Terminated: ok {rc=0} 15:44:55.038515 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 15:44:56.320279 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:44:56.326389 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 15:44:56.347394 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 15:44:56.385628 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 15:44:56.470601 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 15:44:56.491029 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 15:44:56.529182 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 15:44:57.121183 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 15:44:57.169289 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:57.180010 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:44:57.235644 tst cs_paging_gprs_active.py: using LAC 28970 15:44:57.353582 tst cs_paging_gprs_active.py: using RAC 155 15:44:57.470230 tst cs_paging_gprs_active.py: using CellId 28970 15:44:57.589267 tst cs_paging_gprs_active.py: using BVCI 28971 15:44:57.697302 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:57.708174 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:57.718795 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:57.729321 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:57.740353 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:57.751219 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:57.762227 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:57.772900 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:57.783889 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:44:57.901390 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:44:58.020051 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:44:58.235078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:58.552331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20055): Launched 15:44:58.827740 run iperf3-srv_10.42.42.10(pid=20056): Launched 15:44:58.946188 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:44:59.160308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:59.478196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20057): Launched 15:44:59.752611 run iperf3-srv_10.42.42.10(pid=20058): Launched 15:44:59.871350 tst cs_paging_gprs_active.py:38: start network... 15:45:00.085189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:00.574518 run create_hlr_db(pid=20059): Launched 15:45:00.703382 bus /gobi_6: Setting Powered False 15:45:01.768811 run create_hlr_db(pid=20059): Terminated: ok {rc=0} 15:45:02.234525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20064): Launched 15:45:02.537426 run osmo-hlr_10.42.42.2(pid=20065): Launched 15:45:02.651815 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:03.178838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20067): Launched 15:45:03.472896 run osmo-stp_10.42.42.5(pid=20068): Launched 15:45:03.584914 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:04.093386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20070): Launched 15:45:04.207428 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:04.456528 run patchelf(pid=20071): Launched 15:45:04.620491 run osmo-stp_10.42.42.5(pid=20068): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20068)] 15:45:04.745691 run osmo-stp_10.42.42.5(pid=20068): stdout: | (launched: 2022-12-10_15:45:03.419412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:04.874002 run osmo-stp_10.42.42.5(pid=20068): stderr: | [0;m[38;5;43m20221210154503588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154503589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154503589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154503589 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154503590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154503590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154503590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:05.001519 run osmo-stp_10.42.42.5(pid=20068): stdout: | (launched: 2022-12-10_15:45:03.419412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:05.122781 run osmo-stp_10.42.42.5(pid=20068): stderr: | [0;m[38;5;43m20221210154503588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154503589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154503589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154503589 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154503590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154503590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154503590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:05.266511 run patchelf(pid=20071): Terminating (SIGINT) 15:45:05.433452 run patchelf(pid=20071): Terminated: ok {rc=0} 15:45:05.553687 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20068): Process ended prematurely: osmo-stp_10.42.42.5(pid=20068) [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20068)] [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 15:45:05.563028 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 15:45:05.590390 run osmo-hlr_10.42.42.2(pid=20065): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20065)] 15:45:05.637474 run osmo-hlr_10.42.42.2(pid=20065): stdout: | (launched: 2022-12-10_15:45:02.483287) 15:45:05.686374 run osmo-hlr_10.42.42.2(pid=20065): stderr: | [0;m[1;31m20221210154502658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154502658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154502658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154502658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154502658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154502658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154502670 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154502678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154502678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154502678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:05.735786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20055): Terminating (SIGTERM) 15:45:05.775512 run iperf3-srv_10.42.42.10(pid=20056): Terminating (SIGTERM) 15:45:05.815212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20057): Terminating (SIGTERM) 15:45:05.854978 run iperf3-srv_10.42.42.10(pid=20058): Terminating (SIGTERM) 15:45:05.894447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20064): Terminating (SIGTERM) 15:45:05.934203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20067): Terminating (SIGTERM) 15:45:05.973792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20070): Terminating (SIGTERM) 15:45:06.013534 --- ParallelTerminationStrategy: PID 20055 died... 15:45:06.032334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20055): Terminated: ok {rc=0} 15:45:06.076928 --- ParallelTerminationStrategy: PID 20056 died... 15:45:06.095407 run iperf3-srv_10.42.42.10(pid=20056): Terminated {rc=256} 15:45:06.139198 --- ParallelTerminationStrategy: PID 20057 died... 15:45:06.157507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20057): Terminated: ok {rc=0} 15:45:06.201492 --- ParallelTerminationStrategy: PID 20058 died... 15:45:06.219826 run iperf3-srv_10.42.42.10(pid=20058): Terminated {rc=256} 15:45:06.263733 --- ParallelTerminationStrategy: PID 20064 died... 15:45:06.282200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20064): Terminated: ok {rc=0} 15:45:06.326090 --- ParallelTerminationStrategy: PID 20067 died... 15:45:06.344492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20067): Terminated: ok {rc=0} 15:45:06.388233 --- ParallelTerminationStrategy: PID 20070 died... 15:45:06.406598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20070): Terminated: ok {rc=0} 15:45:06.488662 bus /gobi_0: Setting Powered False 15:45:07.586125 bus /gobi_0: Setting Powered False 15:45:08.701362 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 15:45:09.848534 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:09.860535 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:45:09.921730 tst iperf3.py: using LAC 28971 15:45:10.046383 tst iperf3.py: using RAC 156 15:45:10.172404 tst iperf3.py: using CellId 28971 15:45:10.298260 tst iperf3.py: using BVCI 28972 15:45:10.413544 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:10.424854 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:10.436072 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:10.447421 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:10.458660 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:10.470105 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:10.481562 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:10.492542 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:10.503994 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:10.620865 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:45:10.836245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:11.155665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20072): Launched 15:45:11.431692 run iperf3-srv_10.42.42.10(pid=20073): Launched 15:45:11.551865 tst iperf3.py:8: start network... 15:45:11.766268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:12.257273 run create_hlr_db(pid=20074): Launched 15:45:12.385968 bus /gobi_6: Setting Powered False 15:45:13.449290 run create_hlr_db(pid=20074): Terminated: ok {rc=0} 15:45:13.890778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Launched 15:45:14.206987 run osmo-hlr_10.42.42.2(pid=20077): Launched 15:45:14.326966 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:14.876406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Launched 15:45:15.192188 run osmo-stp_10.42.42.5(pid=20080): Launched 15:45:15.312191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:15.889190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20082): Launched 15:45:16.013149 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:16.282674 run patchelf(pid=20083): Launched 15:45:16.491768 run osmo-stp_10.42.42.5(pid=20080): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] 15:45:16.626167 run osmo-stp_10.42.42.5(pid=20080): stdout: | (launched: 2022-12-10_15:45:15.135255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:16.759653 run osmo-stp_10.42.42.5(pid=20080): stderr: | [0;m[38;5;43m20221210154515328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154515328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154515328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154515328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154515329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154515329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154515329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:16.892437 run osmo-stp_10.42.42.5(pid=20080): stdout: | (launched: 2022-12-10_15:45:15.135255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:17.018327 run osmo-stp_10.42.42.5(pid=20080): stderr: | [0;m[38;5;43m20221210154515328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154515328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154515328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154515328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154515329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154515329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154515329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:17.167355 run patchelf(pid=20083): Terminating (SIGINT) 15:45:17.337076 run patchelf(pid=20083): Terminated: ok {rc=0} 15:45:17.457974 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20080): Process ended prematurely: osmo-stp_10.42.42.5(pid=20080) [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 15:45:17.467304 tst iperf3.py:8: Test FAILED (7.7 sec) 15:45:17.495840 run osmo-hlr_10.42.42.2(pid=20077): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20077)] 15:45:17.544185 run osmo-hlr_10.42.42.2(pid=20077): stdout: | (launched: 2022-12-10_15:45:14.149919) 15:45:17.594273 run osmo-hlr_10.42.42.2(pid=20077): stderr: | [0;m[1;31m20221210154514349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154514349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154514349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154514349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154514349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154514350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154514362 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154514370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154514371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154514371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:17.644807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20072): Terminating (SIGTERM) 15:45:17.685405 run iperf3-srv_10.42.42.10(pid=20073): Terminating (SIGTERM) 15:45:17.725936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Terminating (SIGTERM) 15:45:17.766665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Terminating (SIGTERM) 15:45:17.807054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20082): Terminating (SIGTERM) 15:45:17.847929 --- ParallelTerminationStrategy: PID 20072 died... 15:45:17.867129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20072): Terminated: ok {rc=0} 15:45:17.912847 --- ParallelTerminationStrategy: PID 20073 died... 15:45:17.931463 run iperf3-srv_10.42.42.10(pid=20073): Terminated {rc=256} 15:45:17.977234 --- ParallelTerminationStrategy: PID 20076 died... 15:45:17.995838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Terminated: ok {rc=0} 15:45:18.041225 --- ParallelTerminationStrategy: PID 20079 died... 15:45:18.059780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Terminated: ok {rc=0} 15:45:18.105117 --- ParallelTerminationStrategy: PID 20082 died... 15:45:18.123702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20082): Terminated: ok {rc=0} 15:45:18.209817 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 15:45:19.355752 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:19.369971 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:45:19.424778 tst iperf3m4.py: using LAC 28972 15:45:19.542094 tst iperf3m4.py: using RAC 157 15:45:19.657832 tst iperf3m4.py: using CellId 28972 15:45:19.774947 tst iperf3m4.py: using BVCI 28973 15:45:19.883844 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:19.894710 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:19.905350 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:19.916610 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:19.927840 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:19.939043 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:19.950410 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:19.961628 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:19.973037 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:20.087406 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:20.203744 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:20.316704 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:20.432429 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:45:20.631402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:20.927899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20084): Launched 15:45:21.185618 run iperf3-srv_10.42.42.10(pid=20085): Launched 15:45:21.296705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:45:21.494091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:21.789765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20086): Launched 15:45:22.046848 run iperf3-srv_10.42.42.10(pid=20087): Launched 15:45:22.157423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:45:22.354430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:22.649663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20088): Launched 15:45:22.906267 run iperf3-srv_10.42.42.10(pid=20089): Launched 15:45:23.016551 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:45:23.213482 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:23.508319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20090): Launched 15:45:23.764485 run iperf3-srv_10.42.42.10(pid=20091): Launched 15:45:23.875084 tst iperf3m4.py:8: start network... 15:45:24.072364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:24.528222 run create_hlr_db(pid=20092): Launched 15:45:24.640437 bus /gobi_6: Setting Powered False 15:45:25.700289 run create_hlr_db(pid=20092): Terminated: ok {rc=0} 15:45:26.134268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20094): Launched 15:45:26.450446 run osmo-hlr_10.42.42.2(pid=20095): Launched 15:45:26.571212 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:27.121643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20097): Launched 15:45:27.436279 run osmo-stp_10.42.42.5(pid=20098): Launched 15:45:27.556504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:28.101684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20100): Launched 15:45:28.222260 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:28.488490 run patchelf(pid=20101): Launched 15:45:28.664431 run osmo-stp_10.42.42.5(pid=20098): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20098)] 15:45:28.798590 run osmo-stp_10.42.42.5(pid=20098): stdout: | (launched: 2022-12-10_15:45:27.379259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:28.935440 run osmo-stp_10.42.42.5(pid=20098): stderr: | [0;m[38;5;43m20221210154527569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154527569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154527570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154527570 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154527570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154527571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154527571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:29.071835 run osmo-stp_10.42.42.5(pid=20098): stdout: | (launched: 2022-12-10_15:45:27.379259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:29.201414 run osmo-stp_10.42.42.5(pid=20098): stderr: | [0;m[38;5;43m20221210154527569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154527569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154527570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154527570 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154527570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154527571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154527571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:29.355330 run patchelf(pid=20101): Terminating (SIGINT) 15:45:29.533235 run patchelf(pid=20101): Terminated: ok {rc=0} 15:45:29.661404 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20098): Process ended prematurely: osmo-stp_10.42.42.5(pid=20098) [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20098)] [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 15:45:29.671828 tst iperf3m4.py:8: Test FAILED (10.4 sec) 15:45:29.700689 run osmo-hlr_10.42.42.2(pid=20095): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20095)] 15:45:29.750484 run osmo-hlr_10.42.42.2(pid=20095): stdout: | (launched: 2022-12-10_15:45:26.393415) 15:45:29.802049 run osmo-hlr_10.42.42.2(pid=20095): stderr: | [0;m[1;31m20221210154526589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154526589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154526589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154526589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154526589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154526589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154526601 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154526610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154526610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154526610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:29.854298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20084): Terminating (SIGTERM) 15:45:29.896204 run iperf3-srv_10.42.42.10(pid=20085): Terminating (SIGTERM) 15:45:29.937851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20086): Terminating (SIGTERM) 15:45:29.979663 run iperf3-srv_10.42.42.10(pid=20087): Terminating (SIGTERM) 15:45:30.021517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20088): Terminating (SIGTERM) 15:45:30.063297 run iperf3-srv_10.42.42.10(pid=20089): Terminating (SIGTERM) 15:45:30.105073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20090): Terminating (SIGTERM) 15:45:30.146838 run iperf3-srv_10.42.42.10(pid=20091): Terminating (SIGTERM) 15:45:30.188426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20094): Terminating (SIGTERM) 15:45:30.230245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20097): Terminating (SIGTERM) 15:45:30.271985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20100): Terminating (SIGTERM) 15:45:30.314002 --- ParallelTerminationStrategy: PID 20084 died... 15:45:30.333941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20084): Terminated: ok {rc=0} 15:45:30.380380 --- ParallelTerminationStrategy: PID 20085 died... 15:45:30.399900 run iperf3-srv_10.42.42.10(pid=20085): Terminated {rc=256} 15:45:30.446253 --- ParallelTerminationStrategy: PID 20086 died... 15:45:30.465929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20086): Terminated: ok {rc=0} 15:45:30.512136 --- ParallelTerminationStrategy: PID 20087 died... 15:45:30.531738 run iperf3-srv_10.42.42.10(pid=20087): Terminated {rc=256} 15:45:30.577777 --- ParallelTerminationStrategy: PID 20088 died... 15:45:30.597370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20088): Terminated: ok {rc=0} 15:45:30.643702 --- ParallelTerminationStrategy: PID 20089 died... 15:45:30.663228 run iperf3-srv_10.42.42.10(pid=20089): Terminated {rc=256} 15:45:30.709523 --- ParallelTerminationStrategy: PID 20090 died... 15:45:30.729133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20090): Terminated: ok {rc=0} 15:45:30.775461 --- ParallelTerminationStrategy: PID 20091 died... 15:45:30.795018 run iperf3-srv_10.42.42.10(pid=20091): Terminated {rc=256} 15:45:30.849808 --- ParallelTerminationStrategy: PID 20094 died... 15:45:30.873780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20094): Terminated: ok {rc=0} 15:45:30.924255 --- ParallelTerminationStrategy: PID 20097 died... 15:45:30.943869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20097): Terminated: ok {rc=0} 15:45:30.992244 --- ParallelTerminationStrategy: PID 20100 died... 15:45:31.011866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20100): Terminated: ok {rc=0} 15:45:31.100713 bus /gobi_4: Setting Powered False 15:45:32.195009 bus /gobi_4: Setting Powered False 15:45:33.308454 bus /gobi_1: Setting Powered False 15:45:34.407107 bus /gobi_1: Setting Powered False 15:45:35.522726 bus /gobi_0: Setting Powered False 15:45:36.621216 bus /gobi_0: Setting Powered False 15:45:37.736790 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 15:45:38.840833 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:38.852698 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:45:38.916424 tst ping.py: using LAC 28973 15:45:39.037467 tst ping.py: using RAC 158 15:45:39.158382 tst ping.py: using CellId 28973 15:45:39.278367 tst ping.py: using BVCI 28974 15:45:39.391164 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:39.402513 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:39.413587 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:39.424613 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:39.435597 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:39.446579 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:39.457815 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:39.468734 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:39.581235 tst ping.py:19: start network... 15:45:39.776003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:40.225545 run create_hlr_db(pid=20102): Launched 15:45:40.336842 bus /gobi_6: Setting Powered False 15:45:41.396037 run create_hlr_db(pid=20102): Terminated: ok {rc=0} 15:45:41.801856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20104): Launched 15:45:42.090920 run osmo-hlr_10.42.42.2(pid=20105): Launched 15:45:42.202594 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:42.708495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20107): Launched 15:45:42.996729 run osmo-stp_10.42.42.5(pid=20108): Launched 15:45:43.107027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:43.606554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20110): Launched 15:45:43.716436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:43.960247 run patchelf(pid=20111): Launched 15:45:44.120480 run osmo-stp_10.42.42.5(pid=20108): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20108)] 15:45:44.242887 run osmo-stp_10.42.42.5(pid=20108): stdout: | (launched: 2022-12-10_15:45:42.944207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:44.367137 run osmo-stp_10.42.42.5(pid=20108): stderr: | [0;m[38;5;43m20221210154543112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154543112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154543113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154543114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154543114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154543114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154543114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:44.491425 run osmo-stp_10.42.42.5(pid=20108): stdout: | (launched: 2022-12-10_15:45:42.944207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:44.609903 run osmo-stp_10.42.42.5(pid=20108): stderr: | [0;m[38;5;43m20221210154543112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154543112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154543113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154543114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154543114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154543114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154543114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:44.750219 run patchelf(pid=20111): Terminating (SIGINT) 15:45:44.912391 run patchelf(pid=20111): Terminated: ok {rc=0} 15:45:45.029285 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20108): Process ended prematurely: osmo-stp_10.42.42.5(pid=20108) [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20108)] [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 15:45:45.037929 tst ping.py:22: Test FAILED (6.2 sec) 15:45:45.064933 run osmo-hlr_10.42.42.2(pid=20105): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20105)] 15:45:45.112444 run osmo-hlr_10.42.42.2(pid=20105): stdout: | (launched: 2022-12-10_15:45:42.038442) 15:45:45.161824 run osmo-hlr_10.42.42.2(pid=20105): stderr: | [0;m[1;31m20221210154542210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154542210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154542210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154542210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154542210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154542210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154542220 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154542228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154542228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154542228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:45.211333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20104): Terminating (SIGTERM) 15:45:45.251053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20107): Terminating (SIGTERM) 15:45:45.290704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20110): Terminating (SIGTERM) 15:45:45.330622 --- ParallelTerminationStrategy: PID 20104 died... 15:45:45.349564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20104): Terminated: ok {rc=0} 15:45:45.393648 --- ParallelTerminationStrategy: PID 20107 died... 15:45:45.411992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20107): Terminated: ok {rc=0} 15:45:45.455932 --- ParallelTerminationStrategy: PID 20110 died... 15:45:45.474340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20110): Terminated: ok {rc=0} 15:45:45.559593 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 15:45:46.651436 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:46.668539 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:45:46.738088 tst ping_idle_ping.py: using LAC 28974 15:45:46.899907 tst ping_idle_ping.py: using RAC 159 15:45:47.041572 tst ping_idle_ping.py: using CellId 28974 15:45:47.164055 tst ping_idle_ping.py: using BVCI 28975 15:45:47.279692 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:47.291122 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:47.302413 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:47.314958 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:47.326067 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:47.337162 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:47.348498 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:47.359618 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:47.472477 tst ping_idle_ping.py:24: start network... 15:45:47.668190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:48.118544 run create_hlr_db(pid=20112): Launched 15:45:48.229132 bus /gobi_6: Setting Powered False 15:45:49.287542 run create_hlr_db(pid=20112): Terminated: ok {rc=0} 15:45:49.716357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20114): Launched 15:45:50.029094 run osmo-hlr_10.42.42.2(pid=20115): Launched 15:45:50.148409 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:50.685506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20117): Launched 15:45:50.997616 run osmo-stp_10.42.42.5(pid=20118): Launched 15:45:51.116463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:51.657658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20120): Launched 15:45:51.776770 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:52.040372 run patchelf(pid=20121): Launched 15:45:52.213524 run osmo-stp_10.42.42.5(pid=20118): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20118)] 15:45:52.345818 run osmo-stp_10.42.42.5(pid=20118): stdout: | (launched: 2022-12-10_15:45:50.941077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:52.480237 run osmo-stp_10.42.42.5(pid=20118): stderr: | [0;m[38;5;43m20221210154551133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154551133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154551133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154551134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154551134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154551134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154551134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:52.614155 run osmo-stp_10.42.42.5(pid=20118): stdout: | (launched: 2022-12-10_15:45:50.941077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:52.742322 run osmo-stp_10.42.42.5(pid=20118): stderr: | [0;m[38;5;43m20221210154551133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154551133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154551133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154551134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154551134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154551134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154551134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:52.894813 run patchelf(pid=20121): Terminating (SIGINT) 15:45:53.069257 run patchelf(pid=20121): Terminated: ok {rc=0} 15:45:53.195433 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20118): Process ended prematurely: osmo-stp_10.42.42.5(pid=20118) [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20118)] [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 15:45:53.204714 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 15:45:53.232654 run osmo-hlr_10.42.42.2(pid=20115): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20115)] 15:45:53.282245 run osmo-hlr_10.42.42.2(pid=20115): stdout: | (launched: 2022-12-10_15:45:49.972648) 15:45:53.333493 run osmo-hlr_10.42.42.2(pid=20115): stderr: | [0;m[1;31m20221210154550172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154550172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154550172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154550172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154550172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154550172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154550184 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154550192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154550193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154550193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:53.385366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20114): Terminating (SIGTERM) 15:45:53.426861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20117): Terminating (SIGTERM) 15:45:53.468463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20120): Terminating (SIGTERM) 15:45:53.510236 --- ParallelTerminationStrategy: PID 20114 died... 15:45:53.530028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20114): Terminated: ok {rc=0} 15:45:53.576217 --- ParallelTerminationStrategy: PID 20117 died... 15:45:53.595753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20117): Terminated: ok {rc=0} 15:45:53.641740 --- ParallelTerminationStrategy: PID 20120 died... 15:45:53.661341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20120): Terminated: ok {rc=0} 15:45:53.748235 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:45:55.039698 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:45:55.046082 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:45:55.067276 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 15:45:55.106886 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 15:45:55.194750 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:45:55.216343 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 15:45:55.255549 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 15:45:55.851002 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 15:45:55.901864 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:55.913388 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:45:55.970898 tst cs_paging_gprs_active.py: using LAC 28975 15:45:56.096798 tst cs_paging_gprs_active.py: using RAC 160 15:45:56.220272 tst cs_paging_gprs_active.py: using CellId 28975 15:45:56.343827 tst cs_paging_gprs_active.py: using BVCI 28976 15:45:56.459367 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:56.470622 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:56.481584 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:56.492441 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:56.503374 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:56.514425 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:56.525536 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:56.536426 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:56.547507 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:45:56.661304 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:45:56.778891 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:45:56.993897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:57.312088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20125): Launched 15:45:57.587419 run iperf3-srv_10.42.42.10(pid=20126): Launched 15:45:57.705560 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:45:57.920242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:58.237513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20127): Launched 15:45:58.512286 run iperf3-srv_10.42.42.10(pid=20128): Launched 15:45:58.630668 tst cs_paging_gprs_active.py:38: start network... 15:45:58.845188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:59.336439 run create_hlr_db(pid=20129): Launched 15:45:59.464272 bus /gobi_6: Setting Powered False 15:46:00.524062 run create_hlr_db(pid=20129): Terminated: ok {rc=0} 15:46:00.979564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20131): Launched 15:46:01.324864 run osmo-hlr_10.42.42.2(pid=20132): Launched 15:46:01.559720 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:02.189701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20134): Launched 15:46:02.513220 run osmo-stp_10.42.42.5(pid=20135): Launched 15:46:02.626524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:03.139136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20137): Launched 15:46:03.251686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:03.501065 run patchelf(pid=20138): Launched 15:46:03.665321 run osmo-stp_10.42.42.5(pid=20135): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20135)] 15:46:03.790487 run osmo-stp_10.42.42.5(pid=20135): stdout: | (launched: 2022-12-10_15:46:02.456194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:03.917629 run osmo-stp_10.42.42.5(pid=20135): stderr: | [0;m[38;5;43m20221210154602626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154602626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154602627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154602627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154602627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154602627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154602628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:04.044752 run osmo-stp_10.42.42.5(pid=20135): stdout: | (launched: 2022-12-10_15:46:02.456194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:04.165845 run osmo-stp_10.42.42.5(pid=20135): stderr: | [0;m[38;5;43m20221210154602626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154602626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154602627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154602627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154602627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154602627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154602628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:04.309594 run patchelf(pid=20138): Terminating (SIGINT) 15:46:04.476113 run patchelf(pid=20138): Terminated: ok {rc=0} 15:46:04.596209 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20135): Process ended prematurely: osmo-stp_10.42.42.5(pid=20135) [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20135)] [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 15:46:04.605708 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 15:46:04.633315 run osmo-hlr_10.42.42.2(pid=20132): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20132)] 15:46:04.680724 run osmo-hlr_10.42.42.2(pid=20132): stdout: | (launched: 2022-12-10_15:46:01.253831) 15:46:04.729757 run osmo-hlr_10.42.42.2(pid=20132): stderr: | [0;m[1;31m20221210154601448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154601448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154601448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154601448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154601448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154601448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154601464 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154601484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154601484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154601484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:04.779196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20125): Terminating (SIGTERM) 15:46:04.819039 run iperf3-srv_10.42.42.10(pid=20126): Terminating (SIGTERM) 15:46:04.858507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20127): Terminating (SIGTERM) 15:46:04.898280 run iperf3-srv_10.42.42.10(pid=20128): Terminating (SIGTERM) 15:46:04.937806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20131): Terminating (SIGTERM) 15:46:04.977484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20134): Terminating (SIGTERM) 15:46:05.017198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20137): Terminating (SIGTERM) 15:46:05.057107 --- ParallelTerminationStrategy: PID 20125 died... 15:46:05.076007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20125): Terminated: ok {rc=0} 15:46:05.120059 --- ParallelTerminationStrategy: PID 20126 died... 15:46:05.138377 run iperf3-srv_10.42.42.10(pid=20126): Terminated {rc=256} 15:46:05.182037 --- ParallelTerminationStrategy: PID 20127 died... 15:46:05.200398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20127): Terminated: ok {rc=0} 15:46:05.244305 --- ParallelTerminationStrategy: PID 20128 died... 15:46:05.262790 run iperf3-srv_10.42.42.10(pid=20128): Terminated {rc=256} 15:46:05.306904 --- ParallelTerminationStrategy: PID 20131 died... 15:46:05.325420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20131): Terminated: ok {rc=0} 15:46:05.369300 --- ParallelTerminationStrategy: PID 20134 died... 15:46:05.387659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20134): Terminated: ok {rc=0} 15:46:05.431416 --- ParallelTerminationStrategy: PID 20137 died... 15:46:05.449906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20137): Terminated: ok {rc=0} 15:46:05.533192 bus /gobi_0: Setting Powered False 15:46:06.629734 bus /gobi_0: Setting Powered False 15:46:07.747769 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 15:46:08.891578 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:08.902929 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:46:08.969297 tst iperf3.py: using LAC 28976 15:46:09.095854 tst iperf3.py: using RAC 161 15:46:09.213363 tst iperf3.py: using CellId 28976 15:46:09.338343 tst iperf3.py: using BVCI 28977 15:46:09.453564 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:09.465139 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:09.476372 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:09.487667 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:09.499037 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:09.510124 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:09.521338 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:09.532311 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:09.543615 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:09.657789 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:46:09.857641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:10.155510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20139): Launched 15:46:10.413189 run iperf3-srv_10.42.42.10(pid=20140): Launched 15:46:10.524055 tst iperf3.py:8: start network... 15:46:10.721871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:11.178815 run create_hlr_db(pid=20141): Launched 15:46:11.292223 bus /gobi_6: Setting Powered False 15:46:12.352404 run create_hlr_db(pid=20141): Terminated: ok {rc=0} 15:46:12.785104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20143): Launched 15:46:13.101499 run osmo-hlr_10.42.42.2(pid=20144): Launched 15:46:13.221910 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:13.768347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20146): Launched 15:46:14.084352 run osmo-stp_10.42.42.5(pid=20147): Launched 15:46:14.204040 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:14.754485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20149): Launched 15:46:14.875959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:15.142832 run patchelf(pid=20150): Launched 15:46:15.318654 run osmo-stp_10.42.42.5(pid=20147): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20147)] 15:46:15.453501 run osmo-stp_10.42.42.5(pid=20147): stdout: | (launched: 2022-12-10_15:46:14.027218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:15.590028 run osmo-stp_10.42.42.5(pid=20147): stderr: | [0;m[38;5;43m20221210154614217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154614217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154614218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154614218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154614218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154614218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154614219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:15.726180 run osmo-stp_10.42.42.5(pid=20147): stdout: | (launched: 2022-12-10_15:46:14.027218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:15.857602 run osmo-stp_10.42.42.5(pid=20147): stderr: | [0;m[38;5;43m20221210154614217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154614217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154614218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154614218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154614218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154614218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154614219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:16.019268 run patchelf(pid=20150): Terminating (SIGINT) 15:46:16.200214 run patchelf(pid=20150): Terminated: ok {rc=0} 15:46:16.331147 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20147): Process ended prematurely: osmo-stp_10.42.42.5(pid=20147) [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20147)] [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 15:46:16.341829 tst iperf3.py:8: Test FAILED (7.5 sec) 15:46:16.371096 run osmo-hlr_10.42.42.2(pid=20144): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20144)] 15:46:16.422290 run osmo-hlr_10.42.42.2(pid=20144): stdout: | (launched: 2022-12-10_15:46:13.044511) 15:46:16.475407 run osmo-hlr_10.42.42.2(pid=20144): stderr: | [0;m[1;31m20221210154613242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154613242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154613242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154613242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154613242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154613242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154613253 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154613261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154613262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154613262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:16.528379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20139): Terminating (SIGTERM) 15:46:16.571647 run iperf3-srv_10.42.42.10(pid=20140): Terminating (SIGTERM) 15:46:16.617363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20143): Terminating (SIGTERM) 15:46:16.660754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20146): Terminating (SIGTERM) 15:46:16.704780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20149): Terminating (SIGTERM) 15:46:16.747952 --- ParallelTerminationStrategy: PID 20139 died... 15:46:16.768147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20139): Terminated: ok {rc=0} 15:46:16.815638 --- ParallelTerminationStrategy: PID 20140 died... 15:46:16.835504 run iperf3-srv_10.42.42.10(pid=20140): Terminated {rc=256} 15:46:16.883068 --- ParallelTerminationStrategy: PID 20143 died... 15:46:16.903220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20143): Terminated: ok {rc=0} 15:46:16.950513 --- ParallelTerminationStrategy: PID 20146 died... 15:46:16.970443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20146): Terminated: ok {rc=0} 15:46:17.017905 --- ParallelTerminationStrategy: PID 20149 died... 15:46:17.038140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20149): Terminated: ok {rc=0} 15:46:17.128761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 15:46:18.278388 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:18.290432 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:46:18.348543 tst iperf3m4.py: using LAC 28977 15:46:18.474307 tst iperf3m4.py: using RAC 162 15:46:18.592192 tst iperf3m4.py: using CellId 28977 15:46:18.710899 tst iperf3m4.py: using BVCI 28978 15:46:18.821250 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:18.832292 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:18.843049 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:18.854547 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:18.866138 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:18.877682 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:18.889196 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:18.900250 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:18.911651 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:19.031645 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:19.148539 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:19.263779 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:19.379121 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:46:19.578069 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:19.875542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20151): Launched 15:46:20.132565 run iperf3-srv_10.42.42.10(pid=20152): Launched 15:46:20.243506 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:46:20.440836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:20.736931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20153): Launched 15:46:20.993792 run iperf3-srv_10.42.42.10(pid=20154): Launched 15:46:21.104742 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:46:21.302418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:21.599748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20155): Launched 15:46:21.856510 run iperf3-srv_10.42.42.10(pid=20156): Launched 15:46:21.966897 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:46:22.164111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:22.459051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20157): Launched 15:46:22.714825 run iperf3-srv_10.42.42.10(pid=20158): Launched 15:46:22.825105 tst iperf3m4.py:8: start network... 15:46:23.022196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:23.478343 run create_hlr_db(pid=20159): Launched 15:46:23.590181 bus /gobi_6: Setting Powered False 15:46:24.649304 run create_hlr_db(pid=20159): Terminated: ok {rc=0} 15:46:25.061931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20161): Launched 15:46:25.356611 run osmo-hlr_10.42.42.2(pid=20162): Launched 15:46:25.469006 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:25.980752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20164): Launched 15:46:26.276037 run osmo-stp_10.42.42.5(pid=20165): Launched 15:46:26.388351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:26.897419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20167): Launched 15:46:27.011218 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:27.261170 run patchelf(pid=20168): Launched 15:46:27.424851 run osmo-stp_10.42.42.5(pid=20165): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20165)] 15:46:27.550925 run osmo-stp_10.42.42.5(pid=20165): stdout: | (launched: 2022-12-10_15:46:26.221945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:27.677886 run osmo-stp_10.42.42.5(pid=20165): stderr: | [0;m[38;5;43m20221210154626387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154626387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154626387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154626387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154626388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154626388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154626388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:27.804872 run osmo-stp_10.42.42.5(pid=20165): stdout: | (launched: 2022-12-10_15:46:26.221945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:27.926016 run osmo-stp_10.42.42.5(pid=20165): stderr: | [0;m[38;5;43m20221210154626387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154626387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154626387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154626387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154626388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154626388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154626388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:28.069399 run patchelf(pid=20168): Terminating (SIGINT) 15:46:28.235381 run patchelf(pid=20168): Terminated: ok {rc=0} 15:46:28.355961 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20165): Process ended prematurely: osmo-stp_10.42.42.5(pid=20165) [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20165)] [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 15:46:28.365442 tst iperf3m4.py:8: Test FAILED (10.1 sec) 15:46:28.392842 run osmo-hlr_10.42.42.2(pid=20162): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20162)] 15:46:28.440644 run osmo-hlr_10.42.42.2(pid=20162): stdout: | (launched: 2022-12-10_15:46:25.302567) 15:46:28.489780 run osmo-hlr_10.42.42.2(pid=20162): stderr: | [0;m[1;31m20221210154625476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154625476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154625476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154625476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154625476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154625476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154625488 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154625498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154625498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154625498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:28.539250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20151): Terminating (SIGTERM) 15:46:28.578808 run iperf3-srv_10.42.42.10(pid=20152): Terminating (SIGTERM) 15:46:28.618744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20153): Terminating (SIGTERM) 15:46:28.658820 run iperf3-srv_10.42.42.10(pid=20154): Terminating (SIGTERM) 15:46:28.698647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20155): Terminating (SIGTERM) 15:46:28.738551 run iperf3-srv_10.42.42.10(pid=20156): Terminating (SIGTERM) 15:46:28.778293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20157): Terminating (SIGTERM) 15:46:28.818179 run iperf3-srv_10.42.42.10(pid=20158): Terminating (SIGTERM) 15:46:28.857871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20161): Terminating (SIGTERM) 15:46:28.897645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20164): Terminating (SIGTERM) 15:46:28.937395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20167): Terminating (SIGTERM) 15:46:28.977825 --- ParallelTerminationStrategy: PID 20151 died... 15:46:28.996870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20151): Terminated: ok {rc=0} 15:46:29.041375 --- ParallelTerminationStrategy: PID 20152 died... 15:46:29.059788 run iperf3-srv_10.42.42.10(pid=20152): Terminated {rc=256} 15:46:29.104200 --- ParallelTerminationStrategy: PID 20153 died... 15:46:29.122822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20153): Terminated: ok {rc=0} 15:46:29.166888 --- ParallelTerminationStrategy: PID 20154 died... 15:46:29.185337 run iperf3-srv_10.42.42.10(pid=20154): Terminated {rc=256} 15:46:29.229354 --- ParallelTerminationStrategy: PID 20155 died... 15:46:29.247868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20155): Terminated: ok {rc=0} 15:46:29.291960 --- ParallelTerminationStrategy: PID 20156 died... 15:46:29.310455 run iperf3-srv_10.42.42.10(pid=20156): Terminated {rc=256} 15:46:29.354537 --- ParallelTerminationStrategy: PID 20157 died... 15:46:29.372888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20157): Terminated: ok {rc=0} 15:46:29.417041 --- ParallelTerminationStrategy: PID 20158 died... 15:46:29.435528 run iperf3-srv_10.42.42.10(pid=20158): Terminated {rc=256} 15:46:29.479526 --- ParallelTerminationStrategy: PID 20161 died... 15:46:29.498387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20161): Terminated: ok {rc=0} 15:46:29.542495 --- ParallelTerminationStrategy: PID 20164 died... 15:46:29.561129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20164): Terminated: ok {rc=0} 15:46:29.605672 --- ParallelTerminationStrategy: PID 20167 died... 15:46:29.624159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20167): Terminated: ok {rc=0} 15:46:29.707559 bus /gobi_4: Setting Powered False 15:46:30.803042 bus /gobi_4: Setting Powered False 15:46:31.936457 bus /gobi_1: Setting Powered False 15:46:33.032479 bus /gobi_1: Setting Powered False 15:46:34.143632 bus /gobi_0: Setting Powered False 15:46:35.241683 bus /gobi_0: Setting Powered False 15:46:36.356468 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 15:46:37.458885 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:37.471031 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:46:37.532563 tst ping.py: using LAC 28978 15:46:37.652129 tst ping.py: using RAC 163 15:46:37.765510 tst ping.py: using CellId 28978 15:46:37.880597 tst ping.py: using BVCI 28979 15:46:37.986245 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:37.997366 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:38.008084 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:38.018922 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:38.029769 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:38.040373 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:38.051437 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:38.062279 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:38.177974 tst ping.py:19: start network... 15:46:38.387797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:38.869662 run create_hlr_db(pid=20169): Launched 15:46:38.996820 bus /gobi_6: Setting Powered False 15:46:40.059112 run create_hlr_db(pid=20169): Terminated: ok {rc=0} 15:46:40.493289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20171): Launched 15:46:40.803926 run osmo-hlr_10.42.42.2(pid=20172): Launched 15:46:40.921986 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:41.461094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20174): Launched 15:46:41.773093 run osmo-stp_10.42.42.5(pid=20175): Launched 15:46:41.893122 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:42.431306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20177): Launched 15:46:42.549864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:42.812830 run patchelf(pid=20178): Launched 15:46:42.986999 run osmo-stp_10.42.42.5(pid=20175): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20175)] 15:46:43.119324 run osmo-stp_10.42.42.5(pid=20175): stdout: | (launched: 2022-12-10_15:46:41.716618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:43.253198 run osmo-stp_10.42.42.5(pid=20175): stderr: | [0;m[38;5;43m20221210154641909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154641909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154641909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154641910 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154641910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154641910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154641910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:43.387239 run osmo-stp_10.42.42.5(pid=20175): stdout: | (launched: 2022-12-10_15:46:41.716618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:43.515440 run osmo-stp_10.42.42.5(pid=20175): stderr: | [0;m[38;5;43m20221210154641909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154641909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154641909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154641910 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154641910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154641910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154641910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:43.668185 run patchelf(pid=20178): Terminating (SIGINT) 15:46:43.842976 run patchelf(pid=20178): Terminated: ok {rc=0} 15:46:43.969571 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20175): Process ended prematurely: osmo-stp_10.42.42.5(pid=20175) [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20175)] [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 15:46:43.978965 tst ping.py:22: Test FAILED (6.5 sec) 15:46:44.007081 run osmo-hlr_10.42.42.2(pid=20172): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20172)] 15:46:44.057358 run osmo-hlr_10.42.42.2(pid=20172): stdout: | (launched: 2022-12-10_15:46:40.747415) 15:46:44.109388 run osmo-hlr_10.42.42.2(pid=20172): stderr: | [0;m[1;31m20221210154640945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154640945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154640945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154640945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154640945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154640945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154640957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154640966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154640966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154640966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:44.161841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20171): Terminating (SIGTERM) 15:46:44.204187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20174): Terminating (SIGTERM) 15:46:44.246387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20177): Terminating (SIGTERM) 15:46:44.288731 --- ParallelTerminationStrategy: PID 20171 died... 15:46:44.308928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20171): Terminated: ok {rc=0} 15:46:44.355463 --- ParallelTerminationStrategy: PID 20174 died... 15:46:44.374936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20174): Terminated: ok {rc=0} 15:46:44.421425 --- ParallelTerminationStrategy: PID 20177 died... 15:46:44.441066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20177): Terminated: ok {rc=0} 15:46:44.528807 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 15:46:45.616825 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:45.628852 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:46:45.688887 tst ping_idle_ping.py: using LAC 28979 15:46:45.813142 tst ping_idle_ping.py: using RAC 164 15:46:45.967500 tst ping_idle_ping.py: using CellId 28979 15:46:46.098574 tst ping_idle_ping.py: using BVCI 28980 15:46:46.215034 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:46.227164 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:46.239088 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:46.250914 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:46.262755 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:46.274683 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:46.286774 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:46.298655 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:46.414668 tst ping_idle_ping.py:24: start network... 15:46:46.630815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:47.135385 run create_hlr_db(pid=20179): Launched 15:46:47.246942 bus /gobi_6: Setting Powered False 15:46:48.305940 run create_hlr_db(pid=20179): Terminated: ok {rc=0} 15:46:48.736144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20181): Launched 15:46:49.031946 run osmo-hlr_10.42.42.2(pid=20182): Launched 15:46:49.143253 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:49.653560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20184): Launched 15:46:49.944307 run osmo-stp_10.42.42.5(pid=20185): Launched 15:46:50.056108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:50.561298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20187): Launched 15:46:50.673289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:50.920940 run patchelf(pid=20188): Launched 15:46:51.082964 run osmo-stp_10.42.42.5(pid=20185): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20185)] 15:46:51.207588 run osmo-stp_10.42.42.5(pid=20185): stdout: | (launched: 2022-12-10_15:46:49.891211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:51.333647 run osmo-stp_10.42.42.5(pid=20185): stderr: | [0;m[38;5;43m20221210154650060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154650060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154650061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154650061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154650062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154650062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154650062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:51.459720 run osmo-stp_10.42.42.5(pid=20185): stdout: | (launched: 2022-12-10_15:46:49.891211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:51.579772 run osmo-stp_10.42.42.5(pid=20185): stderr: | [0;m[38;5;43m20221210154650060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154650060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154650061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154650061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154650062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154650062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154650062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:51.722119 run patchelf(pid=20188): Terminating (SIGINT) 15:46:51.886926 run patchelf(pid=20188): Terminated: ok {rc=0} 15:46:52.005383 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20185): Process ended prematurely: osmo-stp_10.42.42.5(pid=20185) [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20185)] [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 15:46:52.014156 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 15:46:52.040608 run osmo-hlr_10.42.42.2(pid=20182): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20182)] 15:46:52.088264 run osmo-hlr_10.42.42.2(pid=20182): stdout: | (launched: 2022-12-10_15:46:48.979013) 15:46:52.139068 run osmo-hlr_10.42.42.2(pid=20182): stderr: | [0;m[1;31m20221210154649151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154649151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154649151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154649151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154649151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154649151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154649164 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154649173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154649173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154649173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:52.189411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20181): Terminating (SIGTERM) 15:46:52.229828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20184): Terminating (SIGTERM) 15:46:52.269535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20187): Terminating (SIGTERM) 15:46:52.310130 --- ParallelTerminationStrategy: PID 20181 died... 15:46:52.329694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20181): Terminated: ok {rc=0} 15:46:52.373902 --- ParallelTerminationStrategy: PID 20184 died... 15:46:52.392596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20184): Terminated: ok {rc=0} 15:46:52.437164 --- ParallelTerminationStrategy: PID 20187 died... 15:46:52.456202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20187): Terminated: ok {rc=0} 15:46:52.539591 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:46:53.834194 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:46:53.841745 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:46:53.863439 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 15:46:53.901100 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:46:53.956849 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:46:53.979248 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 15:46:54.014456 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:46:54.567159 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 15:46:54.572363 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:54.583459 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:46:54.638947 tst switch_tch_pdch.py: using LAC 28980 15:46:54.756072 tst switch_tch_pdch.py: using RAC 165 15:46:54.880164 tst switch_tch_pdch.py: using CellId 28980 15:46:55.002996 tst switch_tch_pdch.py: using BVCI 28981 15:46:55.117841 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:55.129823 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:55.141573 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:55.153371 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:55.164874 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:55.176293 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:55.188482 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:55.199897 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:46:55.313884 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:46:55.427208 tst switch_tch_pdch.py:51: start network... 15:46:55.620651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:56.070911 run create_hlr_db(pid=20192): Launched 15:46:56.182509 bus /gobi_6: Setting Powered False 15:46:57.239875 run create_hlr_db(pid=20192): Terminated: ok {rc=0} 15:46:57.666815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20194): Launched 15:46:57.978516 run osmo-hlr_10.42.42.2(pid=20195): Launched 15:46:58.096841 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:58.637040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20197): Launched 15:46:58.949100 run osmo-stp_10.42.42.5(pid=20198): Launched 15:46:59.067951 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:59.605238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20200): Launched 15:46:59.723600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:59.985296 run patchelf(pid=20201): Launched 15:47:00.157307 run osmo-stp_10.42.42.5(pid=20198): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20198)] 15:47:00.289452 run osmo-stp_10.42.42.5(pid=20198): stdout: | (launched: 2022-12-10_15:46:58.892468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:00.423057 run osmo-stp_10.42.42.5(pid=20198): stderr: | [0;m[38;5;43m20221210154659086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154659087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154659087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154659087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154659088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154659088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154659088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:00.556414 run osmo-stp_10.42.42.5(pid=20198): stdout: | (launched: 2022-12-10_15:46:58.892468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:00.683935 run osmo-stp_10.42.42.5(pid=20198): stderr: | [0;m[38;5;43m20221210154659086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154659087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154659087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154659087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154659088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154659088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154659088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:00.838381 run patchelf(pid=20201): Terminating (SIGINT) 15:47:01.032341 run patchelf(pid=20201): Terminated: ok {rc=0} 15:47:01.162337 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20198): Process ended prematurely: osmo-stp_10.42.42.5(pid=20198) [trial-2376↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20198)] [trial-2376↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 15:47:01.172277 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 15:47:01.201533 run osmo-hlr_10.42.42.2(pid=20195): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20195)] 15:47:01.253730 run osmo-hlr_10.42.42.2(pid=20195): stdout: | (launched: 2022-12-10_15:46:57.921889) 15:47:01.306858 run osmo-hlr_10.42.42.2(pid=20195): stderr: | [0;m[1;31m20221210154658118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154658118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154658118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154658118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154658118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154658118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154658130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154658138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154658138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154658138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:01.360526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20194): Terminating (SIGTERM) 15:47:01.404437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20197): Terminating (SIGTERM) 15:47:01.449717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20200): Terminating (SIGTERM) 15:47:01.494904 --- ParallelTerminationStrategy: PID 20194 died... 15:47:01.515414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20194): Terminated: ok {rc=0} 15:47:01.563224 --- ParallelTerminationStrategy: PID 20197 died... 15:47:01.583642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20197): Terminated: ok {rc=0} 15:47:01.631042 --- ParallelTerminationStrategy: PID 20200 died... 15:47:01.651343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20200): Terminated: ok {rc=0} 15:47:01.751576 bus /gobi_0: Setting Powered False 15:47:02.849886 bus /gobi_0: Setting Powered False 15:47:03.964437 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 15:47:05.198915 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:05.204613 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 15:47:05.225881 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 15:47:05.260488 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 15:47:05.313867 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 15:47:05.334611 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 15:47:05.369390 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 15:47:05.919948 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 15:47:05.925323 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:47:05.936256 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 15:47:05.996518 tst switch_tch_pdch.py: using LAC 28981 15:47:06.118600 tst switch_tch_pdch.py: using RAC 166 15:47:06.239863 tst switch_tch_pdch.py: using CellId 28981 15:47:06.359774 tst switch_tch_pdch.py: using BVCI 28982 15:47:06.467369 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:47:06.478479 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:47:06.489303 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:47:06.500276 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:47:06.511308 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:47:06.522494 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:47:06.534331 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:47:06.545551 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:47:06.662651 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:47:06.781616 tst switch_tch_pdch.py:51: start network... 15:47:06.992117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:07.447684 run create_hlr_db(pid=20205): Launched 15:47:07.574194 bus /gobi_6: Setting Powered False 15:47:08.636783 run create_hlr_db(pid=20205): Terminated: ok {rc=0} 15:47:09.029409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20207): Launched 15:47:09.320469 run osmo-hlr_10.42.42.2(pid=20208): Launched 15:47:09.432238 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:09.921654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20210): Launched 15:47:10.212298 run osmo-stp_10.42.42.5(pid=20211): Launched 15:47:10.323081 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:10.799294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20213): Launched 15:47:10.910466 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:11.155707 run patchelf(pid=20214): Launched 15:47:11.317115 run osmo-stp_10.42.42.5(pid=20211): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20211)] 15:47:11.440860 run osmo-stp_10.42.42.5(pid=20211): stdout: | (launched: 2022-12-10_15:47:10.158806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:11.566489 run osmo-stp_10.42.42.5(pid=20211): stderr: | [0;m[38;5;43m20221210154710328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154710328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154710328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154710329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154710329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154710329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154710329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:11.692216 run osmo-stp_10.42.42.5(pid=20211): stdout: | (launched: 2022-12-10_15:47:10.158806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:11.811983 run osmo-stp_10.42.42.5(pid=20211): stderr: | [0;m[38;5;43m20221210154710328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154710328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154710328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154710329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154710329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154710329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154710329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:11.954337 run patchelf(pid=20214): Terminating (SIGINT) 15:47:12.118199 run patchelf(pid=20214): Terminated: ok {rc=0} 15:47:12.235980 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20211): Process ended prematurely: osmo-stp_10.42.42.5(pid=20211) [trial-2376↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20211)] [trial-2376↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 15:47:12.245294 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 15:47:12.273038 run osmo-hlr_10.42.42.2(pid=20208): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20208)] 15:47:12.321280 run osmo-hlr_10.42.42.2(pid=20208): stdout: | (launched: 2022-12-10_15:47:09.267523) 15:47:12.371277 run osmo-hlr_10.42.42.2(pid=20208): stderr: | [0;m[1;31m20221210154709443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154709443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154709443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154709443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154709443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154709443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154709457 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154709466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154709467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154709467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:12.421754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20207): Terminating (SIGTERM) 15:47:12.462046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20210): Terminating (SIGTERM) 15:47:12.502312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20213): Terminating (SIGTERM) 15:47:12.542894 --- ParallelTerminationStrategy: PID 20207 died... 15:47:12.562043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20207): Terminated: ok {rc=0} 15:47:12.606864 --- ParallelTerminationStrategy: PID 20210 died... 15:47:12.625443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20210): Terminated: ok {rc=0} 15:47:12.669726 --- ParallelTerminationStrategy: PID 20213 died... 15:47:12.688228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20213): Terminated: ok {rc=0} 15:47:12.771450 bus /gobi_0: Setting Powered False 15:47:13.868585 bus /gobi_0: Setting Powered False 15:47:14.980709 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_sms:oc2g --------------------------------------------------------------------- 15:47:16.229179 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:16.233589 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 15:47:16.256509 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 15:47:16.265240 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 15:47:16.322083 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 15:47:16.344544 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 15:47:16.353115 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 15:47:16.892748 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 15:47:16.900004 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 15:47:16.912042 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 15:47:16.947598 tst mo_mt_sms.py: using LAC 28982 15:47:17.109290 tst mo_mt_sms.py: using RAC 167 15:47:17.225482 tst mo_mt_sms.py: using CellId 28982 15:47:17.341973 tst mo_mt_sms.py: using BVCI 28983 15:47:17.450029 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 15:47:17.564345 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 15:47:17.683105 tst mo_mt_sms.py:9: start nitb and bts... 15:47:17.894479 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:47:18.530238 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20218): Launched 15:47:18.840832 run osmo-nitb_10.42.42.2(pid=20219): Launched 15:47:19.013667 run osmo-nitb_10.42.42.2(pid=20219): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20219)] 15:47:19.153500 run osmo-nitb_10.42.42.2(pid=20219): stdout: | (launched: 2022-12-10_15:47:18.784743) 15:47:19.294919 run osmo-nitb_10.42.42.2(pid=20219): stderr: | (launched: 2022-12-10_15:47:18.831136) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:47:19.436257 run osmo-nitb_10.42.42.2(pid=20219): stdout: | (launched: 2022-12-10_15:47:18.784743) 15:47:19.571979 run osmo-nitb_10.42.42.2(pid=20219): stderr: | (launched: 2022-12-10_15:47:18.831136) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20219): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20219) [trial-2376↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20219)] 15:47:19.958338 tst osmo-nitb_10.42.42.2(pid=20219): stdout: | (launched: 2022-12-10_15:47:18.784743) 15:47:20.084565 tst osmo-nitb_10.42.42.2(pid=20219): stderr: | (launched: 2022-12-10_15:47:18.831136) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:47:20.233157 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20219): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20219) [trial-2376↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20219)] [trial-2376↪nitb_sms:oc2g↪mo_mt_sms.py:11] 15:47:20.242056 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 15:47:20.248854 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20218): Terminating (SIGTERM) 15:47:20.458752 --- ParallelTerminationStrategy: PID 20218 died... 15:47:20.480253 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20218): Terminated: ok {rc=0} 15:47:20.567032 bus /sierra_3: Setting Powered False 15:47:21.666421 bus /sierra_3: Setting Powered False 15:47:22.781930 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 sms:oc2g --------------------------------------------------------------------- 15:47:23.966558 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:23.971340 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 15:47:23.992534 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 15:47:24.019429 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 15:47:24.070887 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 15:47:24.091703 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 15:47:24.119063 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 15:47:24.666203 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 sms:oc2g mo_mt_sms.py ---------------------------------------------- 15:47:24.671883 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:24.684187 tst sms:oc2g: Using 1 x bts (candidates: 1) 15:47:24.718558 tst mo_mt_sms.py: using LAC 28983 15:47:24.843573 tst mo_mt_sms.py: using RAC 168 15:47:24.966152 tst mo_mt_sms.py: using CellId 28983 15:47:25.086706 tst mo_mt_sms.py: using BVCI 28984 15:47:25.201560 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:25.212532 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:25.223383 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:25.234694 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:25.245936 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:25.257084 tst sms:oc2g: Using 1 x modem (candidates: 2) 15:47:25.369842 tst sms:oc2g: Using 1 x modem (candidates: 2) 15:47:25.486594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:25.971752 run create_hlr_db(pid=20223): Launched 15:47:26.098873 bus /sierra_2: Setting Powered False 15:47:27.160490 run create_hlr_db(pid=20223): Terminated: ok {rc=0} 15:47:27.577503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20225): Launched 15:47:27.868640 run osmo-hlr_10.42.42.2(pid=20226): Launched 15:47:27.979816 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:28.481925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20228): Launched 15:47:28.771574 run osmo-stp_10.42.42.5(pid=20229): Launched 15:47:28.882505 run osmo-msc_10.42.42.6: Starting osmo-msc 15:47:29.407639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20231): Launched 15:47:29.697550 run osmo-msc_10.42.42.6(pid=20232): Launched 15:47:29.860652 run osmo-stp_10.42.42.5(pid=20229): ERR: Terminated: ERROR {rc=1} [trial-2376↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20229)] 15:47:29.984764 run osmo-stp_10.42.42.5(pid=20229): stdout: | (launched: 2022-12-10_15:47:28.718488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:30.109206 run osmo-stp_10.42.42.5(pid=20229): stderr: | [0;m[38;5;43m20221210154728889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154728890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154728890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154728890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154728891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154728891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154728891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:30.231354 run osmo-stp_10.42.42.5(pid=20229): stdout: | (launched: 2022-12-10_15:47:28.718488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:30.348186 run osmo-stp_10.42.42.5(pid=20229): stderr: | [0;m[38;5;43m20221210154728889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154728890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154728890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154728890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154728891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154728891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154728891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:30.487501 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20229): Process ended prematurely: osmo-stp_10.42.42.5(pid=20229) [trial-2376↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20229)] [trial-2376↪sms:oc2g↪mo_mt_sms.py:16] 15:47:30.496063 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 15:47:30.523024 run osmo-hlr_10.42.42.2(pid=20226): ERR: Terminated: ERROR {rc=237} [trial-2376↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20226)] 15:47:30.571074 run osmo-hlr_10.42.42.2(pid=20226): stdout: | (launched: 2022-12-10_15:47:27.815523) 15:47:30.620874 run osmo-hlr_10.42.42.2(pid=20226): stderr: | [0;m[1;31m20221210154727988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154727988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154727988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154727988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154727988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154727988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154728000 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154728008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154728008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154728008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:30.690261 run osmo-msc_10.42.42.6(pid=20232): ERR: Terminated: ERROR {rc=2} [trial-2376↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20232)] 15:47:30.738506 run osmo-msc_10.42.42.6(pid=20232): stdout: | (launched: 2022-12-10_15:47:29.644439) 15:47:30.788197 run osmo-msc_10.42.42.6(pid=20232): stderr: | [0;m[38;5;43m20221210154729916 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154729916 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f43e0e8bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154729916 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154729916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154729916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154729916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154729918 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154729919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154729919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154729919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:47:30.839212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20225): Terminating (SIGTERM) 15:47:30.882202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20228): Terminating (SIGTERM) 15:47:30.926628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20231): Terminating (SIGTERM) 15:47:30.967822 --- ParallelTerminationStrategy: PID 20225 died... 15:47:30.987151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20225): Terminated: ok {rc=0} 15:47:31.032579 --- ParallelTerminationStrategy: PID 20228 died... 15:47:31.051846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20228): Terminated: ok {rc=0} 15:47:31.097789 --- ParallelTerminationStrategy: PID 20231 died... 15:47:31.116825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20231): Terminated: ok {rc=0} 15:47:31.207059 bus /sierra_3: Setting Powered False 15:47:32.313900 bus /sierra_3: Setting Powered False 15:47:33.428880 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_ussd:oc2g --------------------------------------------------------------------- 15:47:34.639797 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:34.644349 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 15:47:34.665564 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 15:47:34.672938 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 15:47:34.708389 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 15:47:34.729606 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 15:47:34.736603 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 15:47:35.256337 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2376 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 15:47:35.261494 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 15:47:35.272376 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 15:47:35.306182 tst assert_extension.py: using LAC 28984 15:47:35.422283 tst assert_extension.py: using RAC 169 15:47:35.536746 tst assert_extension.py: using CellId 28984 15:47:35.653821 tst assert_extension.py: using BVCI 28985 15:47:35.761683 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 15:47:35.876674 tst assert_extension.py:10: start nitb and bts... 15:47:36.089640 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:47:36.725087 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20242): Launched 15:47:37.035537 run osmo-nitb_10.42.42.2(pid=20243): Launched 15:47:37.207064 run osmo-nitb_10.42.42.2(pid=20243): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20243)] 15:47:37.346599 run osmo-nitb_10.42.42.2(pid=20243): stdout: | (launched: 2022-12-10_15:47:36.979061) 15:47:37.487703 run osmo-nitb_10.42.42.2(pid=20243): stderr: | (launched: 2022-12-10_15:47:37.025622) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:47:37.628481 run osmo-nitb_10.42.42.2(pid=20243): stdout: | (launched: 2022-12-10_15:47:36.979061) 15:47:37.763934 run osmo-nitb_10.42.42.2(pid=20243): stderr: | (launched: 2022-12-10_15:47:37.025622) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20243): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20243) [trial-2376↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20243)] 15:47:38.152161 tst osmo-nitb_10.42.42.2(pid=20243): stdout: | (launched: 2022-12-10_15:47:36.979061) 15:47:38.278064 tst osmo-nitb_10.42.42.2(pid=20243): stderr: | (launched: 2022-12-10_15:47:37.025622) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:47:38.426596 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20243): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20243) [trial-2376↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20243)] [trial-2376↪nitb_ussd:oc2g↪assert_extension.py:12] 15:47:38.435275 tst assert_extension.py:12: Test FAILED (3.2 sec) 15:47:38.442355 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20242): Terminating (SIGTERM) 15:47:38.652469 --- ParallelTerminationStrategy: PID 20242 died... 15:47:38.673829 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20242): Terminated: ok {rc=0} 15:47:38.760876 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 ussd:oc2g --------------------------------------------------------------------- 15:47:39.917945 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:39.922501 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 15:47:39.943411 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 15:47:39.971193 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 15:47:40.007120 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 15:47:40.027588 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 15:47:40.054686 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 15:47:40.581865 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 ussd:oc2g assert_extension.py ---------------------------------------------- 15:47:40.586982 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:40.597616 tst ussd:oc2g: Using 1 x bts (candidates: 1) 15:47:40.631981 tst assert_extension.py: using LAC 28985 15:47:40.756406 tst assert_extension.py: using RAC 170 15:47:40.880059 tst assert_extension.py: using CellId 28985 15:47:41.002336 tst assert_extension.py: using BVCI 28986 15:47:41.114659 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:41.125593 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:41.136327 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:41.147108 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:41.157956 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:41.168647 tst ussd:oc2g: Using 1 x modem (candidates: 1) 15:47:41.279624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:41.728027 run create_hlr_db(pid=20247): Launched 15:47:41.839705 bus /sierra_2: Setting Powered False 15:47:42.898762 run create_hlr_db(pid=20247): Terminated: ok {rc=0} 15:47:43.324342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20249): Launched 15:47:43.618146 run osmo-hlr_10.42.42.2(pid=20250): Launched 15:47:43.728917 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:44.247538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20252): Launched 15:47:44.537672 run osmo-stp_10.42.42.5(pid=20253): Launched 15:47:44.648861 run osmo-msc_10.42.42.6: Starting osmo-msc 15:47:45.174418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20255): Launched 15:47:45.463856 run osmo-msc_10.42.42.6(pid=20256): Launched 15:47:45.626279 run osmo-stp_10.42.42.5(pid=20253): ERR: Terminated: ERROR {rc=1} [trial-2376↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20253)] 15:47:45.749956 run osmo-stp_10.42.42.5(pid=20253): stdout: | (launched: 2022-12-10_15:47:44.484587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:45.880655 run osmo-stp_10.42.42.5(pid=20253): stderr: | [0;m[38;5;43m20221210154744653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154744654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154744654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154744654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154744655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154744655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154744655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:46.018249 run osmo-stp_10.42.42.5(pid=20253): stdout: | (launched: 2022-12-10_15:47:44.484587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:46.138586 run osmo-stp_10.42.42.5(pid=20253): stderr: | [0;m[38;5;43m20221210154744653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154744654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154744654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154744654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154744655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154744655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154744655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:46.281970 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20253): Process ended prematurely: osmo-stp_10.42.42.5(pid=20253) [trial-2376↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20253)] [trial-2376↪ussd:oc2g↪assert_extension.py:17] 15:47:46.291097 tst assert_extension.py:17: Test FAILED (5.7 sec) 15:47:46.320469 run osmo-hlr_10.42.42.2(pid=20250): ERR: Terminated: ERROR {rc=237} [trial-2376↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20250)] 15:47:46.370695 run osmo-hlr_10.42.42.2(pid=20250): stdout: | (launched: 2022-12-10_15:47:43.565085) 15:47:46.422230 run osmo-hlr_10.42.42.2(pid=20250): stderr: | [0;m[1;31m20221210154743739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154743739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154743739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154743739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154743739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154743739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154743751 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154743759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154743760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154743760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:46.493721 run osmo-msc_10.42.42.6(pid=20256): ERR: Terminated: ERROR {rc=2} [trial-2376↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20256)] 15:47:46.543997 run osmo-msc_10.42.42.6(pid=20256): stdout: | (launched: 2022-12-10_15:47:45.410821) 15:47:46.595805 run osmo-msc_10.42.42.6(pid=20256): stderr: | [0;m[38;5;43m20221210154745685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154745685 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe6da85ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154745685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154745685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154745685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154745685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154745687 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154745687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154745688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154745688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:47:46.648204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20249): Terminating (SIGTERM) 15:47:46.690776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20252): Terminating (SIGTERM) 15:47:46.734344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20255): Terminating (SIGTERM) 15:47:46.776921 --- ParallelTerminationStrategy: PID 20249 died... 15:47:46.796512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20249): Terminated: ok {rc=0} 15:47:46.843698 --- ParallelTerminationStrategy: PID 20252 died... 15:47:46.863272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20252): Terminated: ok {rc=0} 15:47:46.910371 --- ParallelTerminationStrategy: PID 20255 died... 15:47:46.929913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20255): Terminated: ok {rc=0} 15:47:47.016803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:47:48.209659 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:48.216631 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:47:48.237662 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:47:48.264832 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:47:48.318513 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:47:48.339943 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:47:48.366978 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:47:48.916712 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:47:48.968309 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:48.979676 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:47:49.036554 tst mo_mt_call.py: using LAC 28986 15:47:49.162248 tst mo_mt_call.py: using RAC 171 15:47:49.285655 tst mo_mt_call.py: using CellId 28986 15:47:49.411077 tst mo_mt_call.py: using BVCI 28987 15:47:49.527880 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:49.539321 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:49.550523 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:49.561862 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:49.573156 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:49.584392 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:47:49.701313 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:47:49.818009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:50.310826 run create_hlr_db(pid=20261): Launched 15:47:50.439290 bus /sierra_2: Setting Powered False 15:47:51.498623 run create_hlr_db(pid=20261): Terminated: ok {rc=0} 15:47:51.920497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Launched 15:47:52.216569 run osmo-hlr_10.42.42.2(pid=20264): Launched 15:47:52.328743 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:52.855263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Launched 15:47:53.149597 run osmo-stp_10.42.42.5(pid=20267): Launched 15:47:53.262211 run osmo-msc_10.42.42.6: Starting osmo-msc 15:47:53.796033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20269): Launched 15:47:54.090777 run osmo-msc_10.42.42.6(pid=20270): Launched 15:47:54.255143 run osmo-stp_10.42.42.5(pid=20267): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] 15:47:54.380480 run osmo-stp_10.42.42.5(pid=20267): stdout: | (launched: 2022-12-10_15:47:53.095703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:54.506100 run osmo-stp_10.42.42.5(pid=20267): stderr: | [0;m[38;5;43m20221210154753264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154753264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154753265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154753265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154753265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154753266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154753266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:54.629462 run osmo-stp_10.42.42.5(pid=20267): stdout: | (launched: 2022-12-10_15:47:53.095703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:54.746989 run osmo-stp_10.42.42.5(pid=20267): stderr: | [0;m[38;5;43m20221210154753264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154753264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154753265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154753265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154753265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154753266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154753266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:54.888203 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20267): Process ended prematurely: osmo-stp_10.42.42.5(pid=20267) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:47:54.897185 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 15:47:54.923909 run osmo-hlr_10.42.42.2(pid=20264): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20264)] 15:47:54.971892 run osmo-hlr_10.42.42.2(pid=20264): stdout: | (launched: 2022-12-10_15:47:52.162524) 15:47:55.021297 run osmo-hlr_10.42.42.2(pid=20264): stderr: | [0;m[1;31m20221210154752338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154752338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154752338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154752338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154752338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154752338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154752349 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154752358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154752359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154752359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:55.089843 run osmo-msc_10.42.42.6(pid=20270): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20270)] 15:47:55.137886 run osmo-msc_10.42.42.6(pid=20270): stdout: | (launched: 2022-12-10_15:47:54.037247) 15:47:55.186807 run osmo-msc_10.42.42.6(pid=20270): stderr: | [0;m[38;5;43m20221210154754307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154754308 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8cca27bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154754308 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154754308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154754308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154754308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154754311 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154754312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154754312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154754312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:47:55.236381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Terminating (SIGTERM) 15:47:55.275932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Terminating (SIGTERM) 15:47:55.315530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20269): Terminating (SIGTERM) 15:47:55.355382 --- ParallelTerminationStrategy: PID 20263 died... 15:47:55.374478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Terminated: ok {rc=0} 15:47:55.418830 --- ParallelTerminationStrategy: PID 20266 died... 15:47:55.437471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Terminated: ok {rc=0} 15:47:55.481462 --- ParallelTerminationStrategy: PID 20269 died... 15:47:55.500111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20269): Terminated: ok {rc=0} 15:47:55.583491 bus /sierra_3: Setting Powered False 15:47:56.678221 bus /sierra_3: Setting Powered False 15:47:57.793977 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:47:58.942588 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:58.954715 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:47:59.016416 tst mo_mt_call_osmux.py: using LAC 28987 15:47:59.133870 tst mo_mt_call_osmux.py: using RAC 172 15:47:59.250466 tst mo_mt_call_osmux.py: using CellId 28987 15:47:59.368210 tst mo_mt_call_osmux.py: using BVCI 28988 15:47:59.486516 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:59.498041 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:59.509394 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:59.520647 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:59.532166 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:59.543585 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:47:59.659828 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:47:59.778110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:00.271507 run create_hlr_db(pid=20272): Launched 15:48:00.400227 bus /sierra_2: Setting Powered False 15:48:01.458563 run create_hlr_db(pid=20272): Terminated: ok {rc=0} 15:48:01.903202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20274): Launched 15:48:02.233292 run osmo-hlr_10.42.42.2(pid=20275): Launched 15:48:02.366409 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:02.916821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20277): Launched 15:48:03.234268 run osmo-stp_10.42.42.5(pid=20278): Launched 15:48:03.354181 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:03.926308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20280): Launched 15:48:04.242830 run osmo-msc_10.42.42.6(pid=20281): Launched 15:48:04.419975 run osmo-stp_10.42.42.5(pid=20278): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20278)] 15:48:04.554010 run osmo-stp_10.42.42.5(pid=20278): stdout: | (launched: 2022-12-10_15:48:03.176896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:04.688431 run osmo-stp_10.42.42.5(pid=20278): stderr: | [0;m[38;5;43m20221210154803368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154803368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154803369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154803369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154803371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154803371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154803371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:04.822326 run osmo-stp_10.42.42.5(pid=20278): stdout: | (launched: 2022-12-10_15:48:03.176896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:04.949906 run osmo-stp_10.42.42.5(pid=20278): stderr: | [0;m[38;5;43m20221210154803368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154803368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154803369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154803369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154803371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154803371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154803371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:05.102077 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20278): Process ended prematurely: osmo-stp_10.42.42.5(pid=20278) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20278)] [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:48:05.111488 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:48:05.139387 run osmo-hlr_10.42.42.2(pid=20275): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20275)] 15:48:05.189304 run osmo-hlr_10.42.42.2(pid=20275): stdout: | (launched: 2022-12-10_15:48:02.172655) 15:48:05.240589 run osmo-hlr_10.42.42.2(pid=20275): stderr: | [0;m[1;31m20221210154802384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154802384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154802384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154802384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154802384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154802384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154802397 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154802407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154802407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154802407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:05.312209 run osmo-msc_10.42.42.6(pid=20281): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20281)] 15:48:05.361905 run osmo-msc_10.42.42.6(pid=20281): stdout: | (launched: 2022-12-10_15:48:04.185667) 15:48:05.413057 run osmo-msc_10.42.42.6(pid=20281): stderr: | [0;m[38;5;43m20221210154804507 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154804507 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c5c6d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154804507 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154804507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154804507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154804507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154804509 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154804510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154804510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154804510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:05.464553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20274): Terminating (SIGTERM) 15:48:05.505854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20277): Terminating (SIGTERM) 15:48:05.547096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20280): Terminating (SIGTERM) 15:48:05.588882 --- ParallelTerminationStrategy: PID 20274 died... 15:48:05.608794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20274): Terminated: ok {rc=0} 15:48:05.655082 --- ParallelTerminationStrategy: PID 20277 died... 15:48:05.675151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20277): Terminated: ok {rc=0} 15:48:05.721314 --- ParallelTerminationStrategy: PID 20280 died... 15:48:05.740640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20280): Terminated: ok {rc=0} 15:48:05.828156 bus /sierra_3: Setting Powered False 15:48:06.927890 bus /sierra_3: Setting Powered False 15:48:08.046770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:48:09.284906 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:09.291822 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:48:09.313075 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:48:09.339985 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:48:09.394443 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:48:09.414853 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:48:09.441644 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:48:09.992615 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:48:10.043589 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:10.055242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:48:10.115716 tst mo_mt_call.py: using LAC 28988 15:48:10.239742 tst mo_mt_call.py: using RAC 173 15:48:10.363548 tst mo_mt_call.py: using CellId 28988 15:48:10.486265 tst mo_mt_call.py: using BVCI 28989 15:48:10.602778 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:10.614302 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:10.625618 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:10.636795 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:10.647992 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:10.659182 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:48:10.775727 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:48:10.892618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:11.384936 run create_hlr_db(pid=20286): Launched 15:48:11.513910 bus /sierra_2: Setting Powered False 15:48:12.577239 run create_hlr_db(pid=20286): Terminated: ok {rc=0} 15:48:13.020669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20288): Launched 15:48:13.337291 run osmo-hlr_10.42.42.2(pid=20289): Launched 15:48:13.458632 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:14.007292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20291): Launched 15:48:14.323196 run osmo-stp_10.42.42.5(pid=20292): Launched 15:48:14.443933 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:15.017693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20294): Launched 15:48:15.335036 run osmo-msc_10.42.42.6(pid=20295): Launched 15:48:15.511307 run osmo-stp_10.42.42.5(pid=20292): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20292)] 15:48:15.644751 run osmo-stp_10.42.42.5(pid=20292): stdout: | (launched: 2022-12-10_15:48:14.265929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:15.779263 run osmo-stp_10.42.42.5(pid=20292): stderr: | [0;m[38;5;43m20221210154814455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154814455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154814456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154814456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154814458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154814459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154814459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:15.920493 run osmo-stp_10.42.42.5(pid=20292): stdout: | (launched: 2022-12-10_15:48:14.265929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:16.051203 run osmo-stp_10.42.42.5(pid=20292): stderr: | [0;m[38;5;43m20221210154814455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154814455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154814456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154814456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154814458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154814459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154814459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:16.205147 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20292): Process ended prematurely: osmo-stp_10.42.42.5(pid=20292) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20292)] [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:48:16.215515 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:48:16.244352 run osmo-hlr_10.42.42.2(pid=20289): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20289)] 15:48:16.295163 run osmo-hlr_10.42.42.2(pid=20289): stdout: | (launched: 2022-12-10_15:48:13.279765) 15:48:16.347879 run osmo-hlr_10.42.42.2(pid=20289): stderr: | [0;m[1;31m20221210154813478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154813478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154813478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154813478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154813478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154813478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154813490 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154813499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154813499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154813499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:16.421061 run osmo-msc_10.42.42.6(pid=20295): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20295)] 15:48:16.471688 run osmo-msc_10.42.42.6(pid=20295): stdout: | (launched: 2022-12-10_15:48:15.277404) 15:48:16.524391 run osmo-msc_10.42.42.6(pid=20295): stderr: | [0;m[38;5;43m20221210154815599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154815599 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fee55203c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154815599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154815599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154815599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154815599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154815601 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154815602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154815602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154815602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:16.577162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20288): Terminating (SIGTERM) 15:48:16.619491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20291): Terminating (SIGTERM) 15:48:16.661922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20294): Terminating (SIGTERM) 15:48:16.704288 --- ParallelTerminationStrategy: PID 20288 died... 15:48:16.724372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20288): Terminated: ok {rc=0} 15:48:16.772693 --- ParallelTerminationStrategy: PID 20291 died... 15:48:16.792811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20291): Terminated: ok {rc=0} 15:48:16.840021 --- ParallelTerminationStrategy: PID 20294 died... 15:48:16.860084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20294): Terminated: ok {rc=0} 15:48:16.949230 bus /sierra_3: Setting Powered False 15:48:18.047976 bus /sierra_3: Setting Powered False 15:48:19.165910 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:48:20.311193 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:20.322827 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:48:20.379531 tst mo_mt_call_osmux.py: using LAC 28989 15:48:20.498487 tst mo_mt_call_osmux.py: using RAC 174 15:48:20.618162 tst mo_mt_call_osmux.py: using CellId 28989 15:48:20.734686 tst mo_mt_call_osmux.py: using BVCI 28990 15:48:20.844727 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:20.855700 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:20.866668 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:20.878261 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:20.889757 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:20.901176 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:48:21.015494 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:48:21.137170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:21.632661 run create_hlr_db(pid=20297): Launched 15:48:21.762688 bus /sierra_2: Setting Powered False 15:48:22.826954 run create_hlr_db(pid=20297): Terminated: ok {rc=0} 15:48:23.251943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20299): Launched 15:48:23.547506 run osmo-hlr_10.42.42.2(pid=20300): Launched 15:48:23.660070 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:24.183623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20302): Launched 15:48:24.478803 run osmo-stp_10.42.42.5(pid=20303): Launched 15:48:24.591112 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:25.123701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20305): Launched 15:48:25.419037 run osmo-msc_10.42.42.6(pid=20306): Launched 15:48:25.584158 run osmo-stp_10.42.42.5(pid=20303): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20303)] 15:48:25.708244 run osmo-stp_10.42.42.5(pid=20303): stdout: | (launched: 2022-12-10_15:48:24.424635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:25.832906 run osmo-stp_10.42.42.5(pid=20303): stderr: | [0;m[38;5;43m20221210154824592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154824592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154824592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154824593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154824593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154824593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154824593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:25.956250 run osmo-stp_10.42.42.5(pid=20303): stdout: | (launched: 2022-12-10_15:48:24.424635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:26.074219 run osmo-stp_10.42.42.5(pid=20303): stderr: | [0;m[38;5;43m20221210154824592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154824592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154824592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154824593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154824593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154824593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154824593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:26.215057 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20303): Process ended prematurely: osmo-stp_10.42.42.5(pid=20303) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20303)] [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:48:26.223784 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 15:48:26.250546 run osmo-hlr_10.42.42.2(pid=20300): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20300)] 15:48:26.298002 run osmo-hlr_10.42.42.2(pid=20300): stdout: | (launched: 2022-12-10_15:48:23.493803) 15:48:26.347092 run osmo-hlr_10.42.42.2(pid=20300): stderr: | [0;m[1;31m20221210154823672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154823672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154823672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154823672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154823672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154823672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154823685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154823694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154823695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154823695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:26.415787 run osmo-msc_10.42.42.6(pid=20306): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20306)] 15:48:26.463424 run osmo-msc_10.42.42.6(pid=20306): stdout: | (launched: 2022-12-10_15:48:25.365139) 15:48:26.512507 run osmo-msc_10.42.42.6(pid=20306): stderr: | [0;m[38;5;43m20221210154825637 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154825637 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f84fbd34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154825637 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154825637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154825638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154825638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154825639 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154825640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154825640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154825640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:26.562094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20299): Terminating (SIGTERM) 15:48:26.601727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20302): Terminating (SIGTERM) 15:48:26.641464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20305): Terminating (SIGTERM) 15:48:26.681459 --- ParallelTerminationStrategy: PID 20299 died... 15:48:26.700384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20299): Terminated: ok {rc=0} 15:48:26.744496 --- ParallelTerminationStrategy: PID 20302 died... 15:48:26.762770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20302): Terminated: ok {rc=0} 15:48:26.806993 --- ParallelTerminationStrategy: PID 20305 died... 15:48:26.825448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20305): Terminated: ok {rc=0} 15:48:26.908631 bus /sierra_3: Setting Powered False 15:48:28.006333 bus /sierra_3: Setting Powered False 15:48:29.120700 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:48:30.354852 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:30.361670 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:48:30.382784 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:48:30.410622 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:48:30.462635 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:48:30.483959 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:48:30.511449 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:48:31.063426 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:48:31.115760 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:31.127791 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:48:31.185927 tst mo_mt_call.py: using LAC 28990 15:48:31.314565 tst mo_mt_call.py: using RAC 175 15:48:31.440531 tst mo_mt_call.py: using CellId 28990 15:48:31.564378 tst mo_mt_call.py: using BVCI 28991 15:48:31.710878 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:31.726563 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:31.743192 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:31.759793 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:31.776926 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:31.793179 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:48:31.937775 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:48:32.065059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:32.561456 run create_hlr_db(pid=20311): Launched 15:48:32.690780 bus /sierra_2: Setting Powered False 15:48:33.753775 run create_hlr_db(pid=20311): Terminated: ok {rc=0} 15:48:34.195741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20313): Launched 15:48:34.512303 run osmo-hlr_10.42.42.2(pid=20314): Launched 15:48:34.632842 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:35.177020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20316): Launched 15:48:35.492700 run osmo-stp_10.42.42.5(pid=20317): Launched 15:48:35.613253 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:36.187404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20319): Launched 15:48:36.505009 run osmo-msc_10.42.42.6(pid=20320): Launched 15:48:36.682001 run osmo-stp_10.42.42.5(pid=20317): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20317)] 15:48:36.815400 run osmo-stp_10.42.42.5(pid=20317): stdout: | (launched: 2022-12-10_15:48:35.435526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:36.950297 run osmo-stp_10.42.42.5(pid=20317): stderr: | [0;m[38;5;43m20221210154835628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154835628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154835628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154835629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154835629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154835629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154835629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:37.083679 run osmo-stp_10.42.42.5(pid=20317): stdout: | (launched: 2022-12-10_15:48:35.435526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:37.210519 run osmo-stp_10.42.42.5(pid=20317): stderr: | [0;m[38;5;43m20221210154835628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154835628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154835628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154835629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154835629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154835629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154835629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:37.362124 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20317): Process ended prematurely: osmo-stp_10.42.42.5(pid=20317) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20317)] [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:48:37.371663 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:48:37.399404 run osmo-hlr_10.42.42.2(pid=20314): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20314)] 15:48:37.449139 run osmo-hlr_10.42.42.2(pid=20314): stdout: | (launched: 2022-12-10_15:48:34.454671) 15:48:37.500741 run osmo-hlr_10.42.42.2(pid=20314): stderr: | [0;m[1;31m20221210154834655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154834655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154834655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154834655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154834656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154834656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154834674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154834685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154834685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154834685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:37.572398 run osmo-msc_10.42.42.6(pid=20320): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20320)] 15:48:37.621961 run osmo-msc_10.42.42.6(pid=20320): stdout: | (launched: 2022-12-10_15:48:36.447577) 15:48:37.673330 run osmo-msc_10.42.42.6(pid=20320): stderr: | [0;m[38;5;43m20221210154836768 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154836768 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f601a406c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154836768 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154836768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154836768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154836769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154836770 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154836771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154836771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154836771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:37.724843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20313): Terminating (SIGTERM) 15:48:37.766183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20316): Terminating (SIGTERM) 15:48:37.807592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20319): Terminating (SIGTERM) 15:48:37.849155 --- ParallelTerminationStrategy: PID 20313 died... 15:48:37.869062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20313): Terminated: ok {rc=0} 15:48:37.915020 --- ParallelTerminationStrategy: PID 20316 died... 15:48:37.934876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20316): Terminated: ok {rc=0} 15:48:37.980844 --- ParallelTerminationStrategy: PID 20319 died... 15:48:38.000701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20319): Terminated: ok {rc=0} 15:48:38.086787 bus /sierra_3: Setting Powered False 15:48:39.186652 bus /sierra_3: Setting Powered False 15:48:40.300724 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:48:41.448835 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:41.461030 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:48:41.519805 tst mo_mt_call_osmux.py: using LAC 28991 15:48:41.645694 tst mo_mt_call_osmux.py: using RAC 176 15:48:41.770043 tst mo_mt_call_osmux.py: using CellId 28991 15:48:41.899034 tst mo_mt_call_osmux.py: using BVCI 28992 15:48:42.015006 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:42.026566 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:42.037837 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:42.049077 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:42.060323 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:42.071593 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:48:42.188862 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:48:42.306001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:42.800639 run create_hlr_db(pid=20322): Launched 15:48:42.930357 bus /sierra_2: Setting Powered False 15:48:43.993425 run create_hlr_db(pid=20322): Terminated: ok {rc=0} 15:48:44.436185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20324): Launched 15:48:44.754197 run osmo-hlr_10.42.42.2(pid=20325): Launched 15:48:44.874270 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:45.418943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20327): Launched 15:48:45.735819 run osmo-stp_10.42.42.5(pid=20328): Launched 15:48:45.856355 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:46.626045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20330): Launched 15:48:47.009232 run osmo-msc_10.42.42.6(pid=20331): Launched 15:48:47.431554 run osmo-stp_10.42.42.5(pid=20328): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20328)] 15:48:47.569631 run osmo-stp_10.42.42.5(pid=20328): stdout: | (launched: 2022-12-10_15:48:45.678554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:47.693827 run osmo-stp_10.42.42.5(pid=20328): stderr: | [0;m[38;5;43m20221210154845904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154845904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154845905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154845905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154845905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154845906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154845906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:47.818517 run osmo-stp_10.42.42.5(pid=20328): stdout: | (launched: 2022-12-10_15:48:45.678554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:47.937456 run osmo-stp_10.42.42.5(pid=20328): stderr: | [0;m[38;5;43m20221210154845904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154845904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154845905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154845905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154845905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154845906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154845906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:48.079817 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20328): Process ended prematurely: osmo-stp_10.42.42.5(pid=20328) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20328)] [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:48:48.088816 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 15:48:48.116150 run osmo-hlr_10.42.42.2(pid=20325): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20325)] 15:48:48.164190 run osmo-hlr_10.42.42.2(pid=20325): stdout: | (launched: 2022-12-10_15:48:44.696659) 15:48:48.214033 run osmo-hlr_10.42.42.2(pid=20325): stderr: | [0;m[1;31m20221210154844893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154844893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154844893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154844893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154844893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154844893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154844906 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154844914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154844914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154844914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:48.283563 run osmo-msc_10.42.42.6(pid=20331): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20331)] 15:48:48.331672 run osmo-msc_10.42.42.6(pid=20331): stdout: | (launched: 2022-12-10_15:48:46.950208) 15:48:48.381236 run osmo-msc_10.42.42.6(pid=20331): stderr: | [0;m[38;5;43m20221210154847325 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154847326 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9677812c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154847327 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154847327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154847327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154847327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154847329 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154847329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154847330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154847330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:48.431459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20324): Terminating (SIGTERM) 15:48:48.471696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20327): Terminating (SIGTERM) 15:48:48.511842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20330): Terminating (SIGTERM) 15:48:48.552265 --- ParallelTerminationStrategy: PID 20324 died... 15:48:48.571411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20324): Terminated: ok {rc=0} 15:48:48.616512 --- ParallelTerminationStrategy: PID 20327 died... 15:48:48.635520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20327): Terminated: ok {rc=0} 15:48:48.680436 --- ParallelTerminationStrategy: PID 20330 died... 15:48:48.699374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20330): Terminated: ok {rc=0} 15:48:48.785628 bus /sierra_3: Setting Powered False 15:48:49.884867 bus /sierra_3: Setting Powered False 15:48:50.999538 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:48:52.231452 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:52.237685 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:48:52.257741 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:48:52.284660 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:48:52.335478 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:48:52.355718 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:48:52.382169 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:48:52.931912 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:48:52.979983 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:52.990921 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:48:53.046245 tst mo_mt_call.py: using LAC 28992 15:48:53.164822 tst mo_mt_call.py: using RAC 177 15:48:53.280587 tst mo_mt_call.py: using CellId 28992 15:48:53.396407 tst mo_mt_call.py: using BVCI 28993 15:48:53.503689 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:53.514656 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:53.525373 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:53.536202 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:53.547080 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:53.558069 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:48:53.672537 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:48:53.792181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:54.286669 run create_hlr_db(pid=20337): Launched 15:48:54.416422 bus /sierra_2: Setting Powered False 15:48:55.479805 run create_hlr_db(pid=20337): Terminated: ok {rc=0} 15:48:55.905300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20339): Launched 15:48:56.201428 run osmo-hlr_10.42.42.2(pid=20340): Launched 15:48:56.314628 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:56.840700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20342): Launched 15:48:57.136190 run osmo-stp_10.42.42.5(pid=20343): Launched 15:48:57.248916 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:57.784320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20345): Launched 15:48:58.080698 run osmo-msc_10.42.42.6(pid=20346): Launched 15:48:58.246169 run osmo-stp_10.42.42.5(pid=20343): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20343)] 15:48:58.372459 run osmo-stp_10.42.42.5(pid=20343): stdout: | (launched: 2022-12-10_15:48:57.081895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:58.498524 run osmo-stp_10.42.42.5(pid=20343): stderr: | [0;m[38;5;43m20221210154857251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154857251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154857251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154857251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154857252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154857252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154857252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:58.621879 run osmo-stp_10.42.42.5(pid=20343): stdout: | (launched: 2022-12-10_15:48:57.081895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:58.740420 run osmo-stp_10.42.42.5(pid=20343): stderr: | [0;m[38;5;43m20221210154857251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154857251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154857251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154857251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154857252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154857252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154857252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:58.882125 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20343): Process ended prematurely: osmo-stp_10.42.42.5(pid=20343) [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20343)] [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:48:58.890912 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 15:48:58.917528 run osmo-hlr_10.42.42.2(pid=20340): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20340)] 15:48:58.965774 run osmo-hlr_10.42.42.2(pid=20340): stdout: | (launched: 2022-12-10_15:48:56.147447) 15:48:59.015215 run osmo-hlr_10.42.42.2(pid=20340): stderr: | [0;m[1;31m20221210154856325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154856325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154856325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154856325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154856325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154856325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154856338 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154856347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154856347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154856347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:59.084725 run osmo-msc_10.42.42.6(pid=20346): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20346)] 15:48:59.132318 run osmo-msc_10.42.42.6(pid=20346): stdout: | (launched: 2022-12-10_15:48:58.025894) 15:48:59.181525 run osmo-msc_10.42.42.6(pid=20346): stderr: | [0;m[38;5;43m20221210154858294 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154858295 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f423339dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154858295 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154858295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154858295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154858295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154858297 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154858298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154858298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154858298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:59.231179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20339): Terminating (SIGTERM) 15:48:59.270715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20342): Terminating (SIGTERM) 15:48:59.310152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20345): Terminating (SIGTERM) 15:48:59.350303 --- ParallelTerminationStrategy: PID 20339 died... 15:48:59.369198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20339): Terminated: ok {rc=0} 15:48:59.413193 --- ParallelTerminationStrategy: PID 20342 died... 15:48:59.431441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20342): Terminated: ok {rc=0} 15:48:59.475424 --- ParallelTerminationStrategy: PID 20345 died... 15:48:59.493976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20345): Terminated: ok {rc=0} 15:48:59.577532 bus /sierra_3: Setting Powered False 15:49:00.674756 bus /sierra_3: Setting Powered False 15:49:01.789049 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:49:02.938653 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:02.950709 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:49:03.009821 tst mo_mt_call_osmux.py: using LAC 28993 15:49:03.136492 tst mo_mt_call_osmux.py: using RAC 178 15:49:03.261449 tst mo_mt_call_osmux.py: using CellId 28993 15:49:03.386124 tst mo_mt_call_osmux.py: using BVCI 28994 15:49:03.502804 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:03.514325 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:03.525646 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:03.537025 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:03.548304 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:03.559688 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:49:03.679148 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:49:03.796317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:04.289377 run create_hlr_db(pid=20349): Launched 15:49:04.418135 bus /sierra_2: Setting Powered False 15:49:05.481650 run create_hlr_db(pid=20349): Terminated: ok {rc=0} 15:49:05.908561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20351): Launched 15:49:06.205434 run osmo-hlr_10.42.42.2(pid=20352): Launched 15:49:06.318647 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:06.833136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20354): Launched 15:49:07.128925 run osmo-stp_10.42.42.5(pid=20355): Launched 15:49:07.241099 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:07.777346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20357): Launched 15:49:08.096760 run osmo-msc_10.42.42.6(pid=20358): Launched 15:49:08.273657 run osmo-stp_10.42.42.5(pid=20355): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20355)] 15:49:08.408052 run osmo-stp_10.42.42.5(pid=20355): stdout: | (launched: 2022-12-10_15:49:07.074748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:08.542933 run osmo-stp_10.42.42.5(pid=20355): stderr: | [0;m[38;5;43m20221210154907242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154907242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154907243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154907243 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154907243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154907243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154907244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:08.677443 run osmo-stp_10.42.42.5(pid=20355): stdout: | (launched: 2022-12-10_15:49:07.074748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:08.804864 run osmo-stp_10.42.42.5(pid=20355): stderr: | [0;m[38;5;43m20221210154907242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154907242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154907243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154907243 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154907243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154907243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154907244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:08.957301 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20355): Process ended prematurely: osmo-stp_10.42.42.5(pid=20355) [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20355)] [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:49:08.966937 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 15:49:08.994911 run osmo-hlr_10.42.42.2(pid=20352): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20352)] 15:49:09.044871 run osmo-hlr_10.42.42.2(pid=20352): stdout: | (launched: 2022-12-10_15:49:06.151475) 15:49:09.096742 run osmo-hlr_10.42.42.2(pid=20352): stderr: | [0;m[1;31m20221210154906328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154906328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154906328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154906328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154906328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154906328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154906340 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154906349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154906349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154906349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:09.168867 run osmo-msc_10.42.42.6(pid=20358): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20358)] 15:49:09.218642 run osmo-msc_10.42.42.6(pid=20358): stdout: | (launched: 2022-12-10_15:49:08.039432) 15:49:09.270208 run osmo-msc_10.42.42.6(pid=20358): stderr: | [0;m[38;5;43m20221210154908361 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154908361 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f60c8166c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154908361 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154908361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154908361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154908362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154908363 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154908364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154908364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154908364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:09.322037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20351): Terminating (SIGTERM) 15:49:09.363827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20354): Terminating (SIGTERM) 15:49:09.405634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20357): Terminating (SIGTERM) 15:49:09.447666 --- ParallelTerminationStrategy: PID 20351 died... 15:49:09.467661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20351): Terminated: ok {rc=0} 15:49:09.514093 --- ParallelTerminationStrategy: PID 20354 died... 15:49:09.533544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20354): Terminated: ok {rc=0} 15:49:09.579898 --- ParallelTerminationStrategy: PID 20357 died... 15:49:09.599533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20357): Terminated: ok {rc=0} 15:49:09.686724 bus /sierra_3: Setting Powered False 15:49:10.786812 bus /sierra_3: Setting Powered False 15:49:11.905272 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:49:13.135225 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:49:13.141787 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:49:13.162054 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:49:13.188121 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:49:13.239382 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:49:13.259629 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:49:13.286306 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:49:13.835995 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:49:13.883780 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:13.894693 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:49:13.948831 tst mo_mt_call.py: using LAC 28994 15:49:14.066509 tst mo_mt_call.py: using RAC 179 15:49:14.185138 tst mo_mt_call.py: using CellId 28994 15:49:14.302204 tst mo_mt_call.py: using BVCI 28995 15:49:14.409635 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:14.420455 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:14.431158 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:14.442245 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:14.453322 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:14.464194 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:49:14.582499 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:49:14.701844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:15.196212 run create_hlr_db(pid=20364): Launched 15:49:15.324788 bus /sierra_2: Setting Powered False 15:49:16.395522 run create_hlr_db(pid=20364): Terminated: ok {rc=0} 15:49:16.850358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20366): Launched 15:49:17.189599 run osmo-hlr_10.42.42.2(pid=20367): Launched 15:49:17.311743 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:17.837754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20369): Launched 15:49:18.135400 run osmo-stp_10.42.42.5(pid=20370): Launched 15:49:18.248322 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:18.783848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20372): Launched 15:49:19.080647 run osmo-msc_10.42.42.6(pid=20373): Launched 15:49:19.285054 run osmo-stp_10.42.42.5(pid=20370): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20370)] 15:49:19.440222 run osmo-stp_10.42.42.5(pid=20370): stdout: | (launched: 2022-12-10_15:49:18.081154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:19.577811 run osmo-stp_10.42.42.5(pid=20370): stderr: | [0;m[38;5;43m20221210154918250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154918250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154918250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154918250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154918251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154918251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154918251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:19.713400 run osmo-stp_10.42.42.5(pid=20370): stdout: | (launched: 2022-12-10_15:49:18.081154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:19.840785 run osmo-stp_10.42.42.5(pid=20370): stderr: | [0;m[38;5;43m20221210154918250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154918250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154918250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154918250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154918251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154918251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154918251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:19.993677 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20370): Process ended prematurely: osmo-stp_10.42.42.5(pid=20370) [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20370)] [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:49:20.003465 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:49:20.031532 run osmo-hlr_10.42.42.2(pid=20367): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20367)] 15:49:20.081737 run osmo-hlr_10.42.42.2(pid=20367): stdout: | (launched: 2022-12-10_15:49:17.121068) 15:49:20.133562 run osmo-hlr_10.42.42.2(pid=20367): stderr: | [0;m[1;31m20221210154917315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154917315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154917315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154917315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154917315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154917315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154917327 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154917335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154917335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154917336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:20.205717 run osmo-msc_10.42.42.6(pid=20373): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20373)] 15:49:20.255959 run osmo-msc_10.42.42.6(pid=20373): stdout: | (launched: 2022-12-10_15:49:19.026512) 15:49:20.307490 run osmo-msc_10.42.42.6(pid=20373): stderr: | [0;m[38;5;43m20221210154919426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154919427 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc20c9d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154919427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154919427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154919427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154919427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154919429 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154919429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154919430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154919430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:20.359486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20366): Terminating (SIGTERM) 15:49:20.401169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20369): Terminating (SIGTERM) 15:49:20.442750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20372): Terminating (SIGTERM) 15:49:20.484755 --- ParallelTerminationStrategy: PID 20366 died... 15:49:20.504823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20366): Terminated: ok {rc=0} 15:49:20.551933 --- ParallelTerminationStrategy: PID 20369 died... 15:49:20.571802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20369): Terminated: ok {rc=0} 15:49:20.617946 --- ParallelTerminationStrategy: PID 20372 died... 15:49:20.637578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20372): Terminated: ok {rc=0} 15:49:20.724688 bus /sierra_3: Setting Powered False 15:49:21.822559 bus /sierra_3: Setting Powered False 15:49:22.939411 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:49:24.083501 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:24.094966 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:49:24.151637 tst mo_mt_call_osmux.py: using LAC 28995 15:49:24.268359 tst mo_mt_call_osmux.py: using RAC 180 15:49:24.391734 tst mo_mt_call_osmux.py: using CellId 28995 15:49:24.508044 tst mo_mt_call_osmux.py: using BVCI 28996 15:49:24.616342 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:24.627426 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:24.638207 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:24.649765 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:24.661242 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:24.672710 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:49:24.792744 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:49:24.907545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:25.368108 run create_hlr_db(pid=20377): Launched 15:49:25.480370 bus /sierra_2: Setting Powered False 15:49:26.539855 run create_hlr_db(pid=20377): Terminated: ok {rc=0} 15:49:26.974573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20379): Launched 15:49:27.290551 run osmo-hlr_10.42.42.2(pid=20380): Launched 15:49:27.410937 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:27.958499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20382): Launched 15:49:28.275120 run osmo-stp_10.42.42.5(pid=20383): Launched 15:49:28.396112 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:28.970743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20385): Launched 15:49:29.287562 run osmo-msc_10.42.42.6(pid=20386): Launched 15:49:29.464792 run osmo-stp_10.42.42.5(pid=20383): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20383)] 15:49:29.597988 run osmo-stp_10.42.42.5(pid=20383): stdout: | (launched: 2022-12-10_15:49:28.217687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:29.731972 run osmo-stp_10.42.42.5(pid=20383): stderr: | [0;m[38;5;43m20221210154928408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154928409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154928409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154928409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154928410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154928410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154928410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:29.865623 run osmo-stp_10.42.42.5(pid=20383): stdout: | (launched: 2022-12-10_15:49:28.217687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:29.992599 run osmo-stp_10.42.42.5(pid=20383): stderr: | [0;m[38;5;43m20221210154928408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154928409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154928409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154928409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154928410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154928410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154928410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:30.144459 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20383): Process ended prematurely: osmo-stp_10.42.42.5(pid=20383) [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20383)] [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:49:30.154108 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 15:49:30.181936 run osmo-hlr_10.42.42.2(pid=20380): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20380)] 15:49:30.231781 run osmo-hlr_10.42.42.2(pid=20380): stdout: | (launched: 2022-12-10_15:49:27.233483) 15:49:30.283012 run osmo-hlr_10.42.42.2(pid=20380): stderr: | [0;m[1;31m20221210154927432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154927432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154927432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154927432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154927432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154927432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154927444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154927453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154927453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154927453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:30.354887 run osmo-msc_10.42.42.6(pid=20386): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20386)] 15:49:30.404301 run osmo-msc_10.42.42.6(pid=20386): stdout: | (launched: 2022-12-10_15:49:29.230200) 15:49:30.455356 run osmo-msc_10.42.42.6(pid=20386): stderr: | [0;m[38;5;43m20221210154929551 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154929551 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc991bbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154929551 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154929551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154929551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154929552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154929553 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154929554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154929554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154929554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:30.506785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20379): Terminating (SIGTERM) 15:49:30.547866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20382): Terminating (SIGTERM) 15:49:30.589166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20385): Terminating (SIGTERM) 15:49:30.630702 --- ParallelTerminationStrategy: PID 20379 died... 15:49:30.650602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20379): Terminated: ok {rc=0} 15:49:30.697238 --- ParallelTerminationStrategy: PID 20382 died... 15:49:30.716620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20382): Terminated: ok {rc=0} 15:49:30.762982 --- ParallelTerminationStrategy: PID 20385 died... 15:49:30.782592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20385): Terminated: ok {rc=0} 15:49:30.868754 bus /sierra_3: Setting Powered False 15:49:31.980405 bus /sierra_3: Setting Powered False 15:49:33.103702 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:49:34.345228 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:49:34.351883 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:49:34.372677 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:49:34.399822 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:49:34.452057 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:49:34.472872 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:49:34.499741 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:49:35.052820 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:49:35.103536 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:35.115081 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:49:35.172817 tst mo_mt_call.py: using LAC 28996 15:49:35.298779 tst mo_mt_call.py: using RAC 181 15:49:35.422119 tst mo_mt_call.py: using CellId 28996 15:49:35.546278 tst mo_mt_call.py: using BVCI 28997 15:49:35.662466 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:35.674554 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:35.685904 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:35.697204 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:35.708366 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:35.719768 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:49:35.833628 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:49:35.951264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:36.443319 run create_hlr_db(pid=20392): Launched 15:49:36.571494 bus /sierra_2: Setting Powered False 15:49:37.634010 run create_hlr_db(pid=20392): Terminated: ok {rc=0} 15:49:38.077716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20394): Launched 15:49:38.393563 run osmo-hlr_10.42.42.2(pid=20395): Launched 15:49:38.514307 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:39.060817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20397): Launched 15:49:39.377424 run osmo-stp_10.42.42.5(pid=20399): Launched 15:49:39.498615 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:40.074726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20401): Launched 15:49:40.391857 run osmo-msc_10.42.42.6(pid=20402): Launched 15:49:40.568620 run osmo-stp_10.42.42.5(pid=20399): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20399)] 15:49:40.702414 run osmo-stp_10.42.42.5(pid=20399): stdout: | (launched: 2022-12-10_15:49:39.320100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:40.837397 run osmo-stp_10.42.42.5(pid=20399): stderr: | [0;m[38;5;43m20221210154939510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154939510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154939511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154939511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154939514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154939515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154939515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:40.971673 run osmo-stp_10.42.42.5(pid=20399): stdout: | (launched: 2022-12-10_15:49:39.320100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:41.099732 run osmo-stp_10.42.42.5(pid=20399): stderr: | [0;m[38;5;43m20221210154939510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154939510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154939511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154939511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154939514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154939515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154939515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:41.251769 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20399): Process ended prematurely: osmo-stp_10.42.42.5(pid=20399) [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20399)] [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:49:41.261201 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:49:41.288937 run osmo-hlr_10.42.42.2(pid=20395): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20395)] 15:49:41.338844 run osmo-hlr_10.42.42.2(pid=20395): stdout: | (launched: 2022-12-10_15:49:38.336439) 15:49:41.390554 run osmo-hlr_10.42.42.2(pid=20395): stderr: | [0;m[1;31m20221210154938535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154938535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154938535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154938535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154938535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154938535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154938548 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154938558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154938558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154938558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:41.462772 run osmo-msc_10.42.42.6(pid=20402): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20402)] 15:49:41.512933 run osmo-msc_10.42.42.6(pid=20402): stdout: | (launched: 2022-12-10_15:49:40.334235) 15:49:41.564512 run osmo-msc_10.42.42.6(pid=20402): stderr: | [0;m[38;5;43m20221210154940655 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154940655 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30b4973c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154940655 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154940656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154940656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154940656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154940658 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154940658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154940658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154940658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:41.616568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20394): Terminating (SIGTERM) 15:49:41.657953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20397): Terminating (SIGTERM) 15:49:41.699377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20401): Terminating (SIGTERM) 15:49:41.741199 --- ParallelTerminationStrategy: PID 20394 died... 15:49:41.760866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20394): Terminated: ok {rc=0} 15:49:41.807178 --- ParallelTerminationStrategy: PID 20397 died... 15:49:41.826760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20397): Terminated: ok {rc=0} 15:49:41.873154 --- ParallelTerminationStrategy: PID 20401 died... 15:49:41.892595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20401): Terminated: ok {rc=0} 15:49:41.980757 bus /sierra_3: Setting Powered False 15:49:43.079273 bus /sierra_3: Setting Powered False 15:49:44.196513 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:49:45.341944 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:45.353595 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:49:45.409357 tst mo_mt_call_osmux.py: using LAC 28997 15:49:45.525391 tst mo_mt_call_osmux.py: using RAC 182 15:49:45.643411 tst mo_mt_call_osmux.py: using CellId 28997 15:49:45.769564 tst mo_mt_call_osmux.py: using BVCI 28998 15:49:45.899321 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:45.911597 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:45.924704 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:45.937958 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:45.950018 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:45.962369 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:49:46.093088 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:49:46.208574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:46.689242 run create_hlr_db(pid=20404): Launched 15:49:46.824725 bus /sierra_2: Setting Powered False 15:49:47.888187 run create_hlr_db(pid=20404): Terminated: ok {rc=0} 15:49:48.316328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20406): Launched 15:49:48.613386 run osmo-hlr_10.42.42.2(pid=20407): Launched 15:49:48.725781 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:49.250018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20409): Launched 15:49:49.545737 run osmo-stp_10.42.42.5(pid=20410): Launched 15:49:49.658290 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:50.192740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20412): Launched 15:49:50.490108 run osmo-msc_10.42.42.6(pid=20413): Launched 15:49:50.655318 run osmo-stp_10.42.42.5(pid=20410): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20410)] 15:49:50.781244 run osmo-stp_10.42.42.5(pid=20410): stdout: | (launched: 2022-12-10_15:49:49.491790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:50.907637 run osmo-stp_10.42.42.5(pid=20410): stderr: | [0;m[38;5;43m20221210154949661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154949661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154949661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154949662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154949663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154949663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154949663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:51.032228 run osmo-stp_10.42.42.5(pid=20410): stdout: | (launched: 2022-12-10_15:49:49.491790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:51.151284 run osmo-stp_10.42.42.5(pid=20410): stderr: | [0;m[38;5;43m20221210154949661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210154949661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210154949661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210154949662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210154949663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210154949663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210154949663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:51.293314 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20410): Process ended prematurely: osmo-stp_10.42.42.5(pid=20410) [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20410)] [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:49:51.302028 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 15:49:51.329056 run osmo-hlr_10.42.42.2(pid=20407): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20407)] 15:49:51.376624 run osmo-hlr_10.42.42.2(pid=20407): stdout: | (launched: 2022-12-10_15:49:48.559099) 15:49:51.425984 run osmo-hlr_10.42.42.2(pid=20407): stderr: | [0;m[1;31m20221210154948737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154948737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154948737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154948737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154948737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154948737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154948750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154948758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154948758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154948758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:51.495292 run osmo-msc_10.42.42.6(pid=20413): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20413)] 15:49:51.543035 run osmo-msc_10.42.42.6(pid=20413): stdout: | (launched: 2022-12-10_15:49:50.436052) 15:49:51.592532 run osmo-msc_10.42.42.6(pid=20413): stderr: | [0;m[38;5;43m20221210154950706 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210154950706 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0aa61acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210154950706 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210154950706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210154950707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210154950707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210154950708 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210154950709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210154950709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210154950709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:51.642261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20406): Terminating (SIGTERM) 15:49:51.682232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20409): Terminating (SIGTERM) 15:49:51.722216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20412): Terminating (SIGTERM) 15:49:51.762532 --- ParallelTerminationStrategy: PID 20406 died... 15:49:51.781733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20406): Terminated: ok {rc=0} 15:49:51.826420 --- ParallelTerminationStrategy: PID 20409 died... 15:49:51.845214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20409): Terminated: ok {rc=0} 15:49:51.889692 --- ParallelTerminationStrategy: PID 20412 died... 15:49:51.908353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20412): Terminated: ok {rc=0} 15:49:51.994262 bus /sierra_3: Setting Powered False 15:49:53.091809 bus /sierra_3: Setting Powered False 15:49:54.206834 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:49:55.438430 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:49:55.444877 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:49:55.466049 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:49:55.493377 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:49:55.545140 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:49:55.566229 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:49:55.593284 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:49:56.143020 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:49:56.193914 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:56.205178 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:49:56.265925 tst mo_mt_call.py: using LAC 28998 15:49:56.385295 tst mo_mt_call.py: using RAC 183 15:49:56.505145 tst mo_mt_call.py: using CellId 28998 15:49:56.621708 tst mo_mt_call.py: using BVCI 28999 15:49:56.729910 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:56.741042 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:56.751839 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:56.763069 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:56.774285 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:56.785570 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:49:56.905299 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:49:57.022941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:57.516307 run create_hlr_db(pid=20418): Launched 15:49:57.646049 bus /sierra_2: Setting Powered False 15:49:58.709831 run create_hlr_db(pid=20418): Terminated: ok {rc=0} 15:49:59.134260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20420): Launched 15:49:59.431562 run osmo-hlr_10.42.42.2(pid=20421): Launched 15:49:59.544489 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:00.067561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20423): Launched 15:50:00.363596 run osmo-stp_10.42.42.5(pid=20424): Launched 15:50:00.476102 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:01.057898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20426): Launched 15:50:01.409686 run osmo-msc_10.42.42.6(pid=20427): Launched 15:50:01.757182 run osmo-stp_10.42.42.5(pid=20424): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20424)] 15:50:01.997603 run osmo-stp_10.42.42.5(pid=20424): stdout: | (launched: 2022-12-10_15:50:00.309611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:02.229259 run osmo-stp_10.42.42.5(pid=20424): stderr: | [0;m[38;5;43m20221210155000477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155000477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155000477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155000478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155000480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155000480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155000480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:02.378036 run osmo-stp_10.42.42.5(pid=20424): stdout: | (launched: 2022-12-10_15:50:00.309611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:02.497538 run osmo-stp_10.42.42.5(pid=20424): stderr: | [0;m[38;5;43m20221210155000477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155000477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155000477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155000478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155000480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155000480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155000480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:02.640049 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20424): Process ended prematurely: osmo-stp_10.42.42.5(pid=20424) [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20424)] [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:50:02.649176 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:50:02.676723 run osmo-hlr_10.42.42.2(pid=20421): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20421)] 15:50:02.725412 run osmo-hlr_10.42.42.2(pid=20421): stdout: | (launched: 2022-12-10_15:49:59.377732) 15:50:02.775655 run osmo-hlr_10.42.42.2(pid=20421): stderr: | [0;m[1;31m20221210154959552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210154959552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210154959552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210154959552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210154959552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210154959552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210154959570 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210154959579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210154959579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210154959579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:02.845892 run osmo-msc_10.42.42.6(pid=20427): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20427)] 15:50:02.894302 run osmo-msc_10.42.42.6(pid=20427): stdout: | (launched: 2022-12-10_15:50:01.335696) 15:50:02.944391 run osmo-msc_10.42.42.6(pid=20427): stderr: | [0;m[38;5;43m20221210155001780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155001781 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f862f672c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155001781 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155001781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155001781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155001781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155001783 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155001783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155001783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155001783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:02.994714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20420): Terminating (SIGTERM) 15:50:03.035189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20423): Terminating (SIGTERM) 15:50:03.075850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20426): Terminating (SIGTERM) 15:50:03.116864 --- ParallelTerminationStrategy: PID 20420 died... 15:50:03.136345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20420): Terminated: ok {rc=0} 15:50:03.181955 --- ParallelTerminationStrategy: PID 20423 died... 15:50:03.200819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20423): Terminated: ok {rc=0} 15:50:03.246341 --- ParallelTerminationStrategy: PID 20426 died... 15:50:03.265331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20426): Terminated: ok {rc=0} 15:50:03.352176 bus /sierra_3: Setting Powered False 15:50:04.451721 bus /sierra_3: Setting Powered False 15:50:05.568524 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:50:06.712536 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:06.724058 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:50:06.780759 tst mo_mt_call_osmux.py: using LAC 28999 15:50:06.899566 tst mo_mt_call_osmux.py: using RAC 184 15:50:07.016668 tst mo_mt_call_osmux.py: using CellId 28999 15:50:07.133380 tst mo_mt_call_osmux.py: using BVCI 29000 15:50:07.241382 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:07.252420 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:07.263295 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:07.274312 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:07.285395 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:07.296392 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:50:07.410744 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:50:07.526591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:07.986765 run create_hlr_db(pid=20432): Launched 15:50:08.099101 bus /sierra_2: Setting Powered False 15:50:09.159107 run create_hlr_db(pid=20432): Terminated: ok {rc=0} 15:50:09.575828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20434): Launched 15:50:09.872429 run osmo-hlr_10.42.42.2(pid=20435): Launched 15:50:09.985736 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:10.507506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20437): Launched 15:50:10.802980 run osmo-stp_10.42.42.5(pid=20438): Launched 15:50:10.915208 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:11.454915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20440): Launched 15:50:11.751400 run osmo-msc_10.42.42.6(pid=20441): Launched 15:50:11.917309 run osmo-stp_10.42.42.5(pid=20438): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20438)] 15:50:12.043634 run osmo-stp_10.42.42.5(pid=20438): stdout: | (launched: 2022-12-10_15:50:10.749090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:12.170465 run osmo-stp_10.42.42.5(pid=20438): stderr: | [0;m[38;5;43m20221210155010921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155010921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155010921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155010922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155010922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155010922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155010922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:12.294345 run osmo-stp_10.42.42.5(pid=20438): stdout: | (launched: 2022-12-10_15:50:10.749090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:12.413190 run osmo-stp_10.42.42.5(pid=20438): stderr: | [0;m[38;5;43m20221210155010921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155010921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155010921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155010922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155010922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155010922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155010922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:12.555254 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20438): Process ended prematurely: osmo-stp_10.42.42.5(pid=20438) [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20438)] [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:50:12.564287 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 15:50:12.591286 run osmo-hlr_10.42.42.2(pid=20435): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20435)] 15:50:12.639293 run osmo-hlr_10.42.42.2(pid=20435): stdout: | (launched: 2022-12-10_15:50:09.818121) 15:50:12.689237 run osmo-hlr_10.42.42.2(pid=20435): stderr: | [0;m[1;31m20221210155009993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155009993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155009993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155009993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155009993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155009993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155010005 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155010013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155010013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155010014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:12.758677 run osmo-msc_10.42.42.6(pid=20441): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20441)] 15:50:12.806797 run osmo-msc_10.42.42.6(pid=20441): stdout: | (launched: 2022-12-10_15:50:11.697299) 15:50:12.856367 run osmo-msc_10.42.42.6(pid=20441): stderr: | [0;m[38;5;43m20221210155011967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155011968 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb45e695c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155011968 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155011968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155011968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155011969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155011971 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155011971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155011971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155011971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:12.906324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20434): Terminating (SIGTERM) 15:50:12.946529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20437): Terminating (SIGTERM) 15:50:12.986897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20440): Terminating (SIGTERM) 15:50:13.027345 --- ParallelTerminationStrategy: PID 20434 died... 15:50:13.046566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20434): Terminated: ok {rc=0} 15:50:13.091215 --- ParallelTerminationStrategy: PID 20437 died... 15:50:13.110098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20437): Terminated: ok {rc=0} 15:50:13.154542 --- ParallelTerminationStrategy: PID 20440 died... 15:50:13.173145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20440): Terminated: ok {rc=0} 15:50:13.257340 bus /sierra_3: Setting Powered False 15:50:14.353141 bus /sierra_3: Setting Powered False 15:50:15.467996 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 emergency:oc2g --------------------------------------------------------------------- 15:50:16.706028 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:50:16.711004 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 15:50:16.736909 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 15:50:16.767230 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 15:50:16.852370 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 15:50:16.888845 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 15:50:16.936717 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 15:50:17.480726 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2376 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 15:50:17.486457 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:17.497417 tst emergency:oc2g: Using 1 x bts (candidates: 1) 15:50:17.534438 tst emergency_mo_mt_call.py: using LAC 29000 15:50:17.652086 tst emergency_mo_mt_call.py: using RAC 185 15:50:17.772124 tst emergency_mo_mt_call.py: using CellId 29000 15:50:17.887383 tst emergency_mo_mt_call.py: using BVCI 29001 15:50:17.993247 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:18.003770 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:18.014154 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:18.025682 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:18.036654 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:18.047702 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:18.162335 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:18.274097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:18.727900 run create_hlr_db(pid=20446): Launched 15:50:18.838780 bus /sierra_2: Setting Powered False 15:50:19.897376 run create_hlr_db(pid=20446): Terminated: ok {rc=0} 15:50:20.326691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20448): Launched 15:50:20.639773 run osmo-hlr_10.42.42.2(pid=20449): Launched 15:50:20.758876 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:21.299895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20451): Launched 15:50:21.612612 run osmo-stp_10.42.42.5(pid=20452): Launched 15:50:21.741541 tst emergency_mo_mt_call.py: using MSISDN 7784 15:50:21.904132 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:22.467877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20454): Launched 15:50:22.780391 run osmo-msc_10.42.42.6(pid=20455): Launched 15:50:22.954628 run osmo-stp_10.42.42.5(pid=20452): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20452)] 15:50:23.087082 run osmo-stp_10.42.42.5(pid=20452): stdout: | (launched: 2022-12-10_15:50:21.555353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:23.219538 run osmo-stp_10.42.42.5(pid=20452): stderr: | [0;m[38;5;43m20221210155021748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155021748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155021748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155021749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155021749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155021749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155021749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:23.351548 run osmo-stp_10.42.42.5(pid=20452): stdout: | (launched: 2022-12-10_15:50:21.555353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:23.476518 run osmo-stp_10.42.42.5(pid=20452): stderr: | [0;m[38;5;43m20221210155021748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155021748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155021748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155021749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155021749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155021749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155021749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:23.625949 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20452): Process ended prematurely: osmo-stp_10.42.42.5(pid=20452) [trial-2376↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20452)] [trial-2376↪emergency:oc2g↪emergency_mo_mt_call.py:19] 15:50:23.634841 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 15:50:23.662269 run osmo-hlr_10.42.42.2(pid=20449): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20449)] 15:50:23.712159 run osmo-hlr_10.42.42.2(pid=20449): stdout: | (launched: 2022-12-10_15:50:20.583132) 15:50:23.763919 run osmo-hlr_10.42.42.2(pid=20449): stderr: | [0;m[1;31m20221210155020782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155020782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155020782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155020782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155020782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155020782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155020795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155020805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155020806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155020806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:23.836374 run osmo-msc_10.42.42.6(pid=20455): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20455)] 15:50:23.886492 run osmo-msc_10.42.42.6(pid=20455): stdout: | (launched: 2022-12-10_15:50:22.723652) 15:50:23.938075 run osmo-msc_10.42.42.6(pid=20455): stderr: | [0;m[38;5;43m20221210155023042 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155023042 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe64cbc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155023042 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155023042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155023043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155023043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155023045 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155023045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155023045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155023045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:23.990367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20448): Terminating (SIGTERM) 15:50:24.032069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20451): Terminating (SIGTERM) 15:50:24.073601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20454): Terminating (SIGTERM) 15:50:24.115773 --- ParallelTerminationStrategy: PID 20448 died... 15:50:24.135914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20448): Terminated: ok {rc=0} 15:50:24.182396 --- ParallelTerminationStrategy: PID 20451 died... 15:50:24.202128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20451): Terminated: ok {rc=0} 15:50:24.248270 --- ParallelTerminationStrategy: PID 20454 died... 15:50:24.267982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20454): Terminated: ok {rc=0} 15:50:24.355274 bus /sierra_3: Setting Powered False 15:50:25.454978 bus /sierra_3: Setting Powered False 15:50:26.570317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 15:50:27.656697 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:27.668581 tst emergency:oc2g: Using 1 x bts (candidates: 1) 15:50:27.711384 tst emergency_preemptive_call.py: using LAC 29001 15:50:27.834877 tst emergency_preemptive_call.py: using RAC 186 15:50:27.955790 tst emergency_preemptive_call.py: using CellId 29001 15:50:28.077671 tst emergency_preemptive_call.py: using BVCI 29002 15:50:28.191092 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:28.202082 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:28.212878 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:28.223725 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:28.234546 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:28.245336 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:28.361174 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:28.476112 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:28.587353 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:28.704091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:29.160052 run create_hlr_db(pid=20457): Launched 15:50:29.272295 bus /sierra_2: Setting Powered False 15:50:30.331513 run create_hlr_db(pid=20457): Terminated: ok {rc=0} 15:50:30.760305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20459): Launched 15:50:31.114365 run osmo-hlr_10.42.42.2(pid=20460): Launched 15:50:31.437960 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:32.153235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20462): Launched 15:50:32.498007 run osmo-stp_10.42.42.5(pid=20463): Launched 15:50:32.621362 tst emergency_preemptive_call.py: using MSISDN 7785 15:50:32.770310 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:33.292561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20465): Launched 15:50:33.583585 run osmo-msc_10.42.42.6(pid=20466): Launched 15:50:33.745923 run osmo-stp_10.42.42.5(pid=20463): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20463)] 15:50:33.869761 run osmo-stp_10.42.42.5(pid=20463): stdout: | (launched: 2022-12-10_15:50:32.444730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:33.994669 run osmo-stp_10.42.42.5(pid=20463): stderr: | [0;m[38;5;43m20221210155032610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155032611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155032611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155032611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155032614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155032614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155032614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:34.116562 run osmo-stp_10.42.42.5(pid=20463): stdout: | (launched: 2022-12-10_15:50:32.444730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:34.232913 run osmo-stp_10.42.42.5(pid=20463): stderr: | [0;m[38;5;43m20221210155032610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155032611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155032611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155032611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155032614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155032614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155032614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:34.372165 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20463): Process ended prematurely: osmo-stp_10.42.42.5(pid=20463) [trial-2376↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20463)] [trial-2376↪emergency:oc2g↪emergency_preemptive_call.py:32] 15:50:34.380508 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 15:50:34.407663 run osmo-hlr_10.42.42.2(pid=20460): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20460)] 15:50:34.456266 run osmo-hlr_10.42.42.2(pid=20460): stdout: | (launched: 2022-12-10_15:50:31.048277) 15:50:34.506232 run osmo-hlr_10.42.42.2(pid=20460): stderr: | [0;m[1;31m20221210155031354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155031354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155031354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155031355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155031355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155031355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155031378 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155031395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155031396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155031396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:34.576418 run osmo-msc_10.42.42.6(pid=20466): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20466)] 15:50:34.624660 run osmo-msc_10.42.42.6(pid=20466): stdout: | (launched: 2022-12-10_15:50:33.530149) 15:50:34.674387 run osmo-msc_10.42.42.6(pid=20466): stderr: | [0;m[38;5;43m20221210155033801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155033802 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90c3f5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155033802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155033802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155033802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155033802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155033804 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155033804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155033805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155033805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:34.724644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20459): Terminating (SIGTERM) 15:50:34.764980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20462): Terminating (SIGTERM) 15:50:34.805491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20465): Terminating (SIGTERM) 15:50:34.846272 --- ParallelTerminationStrategy: PID 20459 died... 15:50:34.865594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20459): Terminated: ok {rc=0} 15:50:34.910770 --- ParallelTerminationStrategy: PID 20462 died... 15:50:34.929541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20462): Terminated: ok {rc=0} 15:50:34.974200 --- ParallelTerminationStrategy: PID 20465 died... 15:50:34.993119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20465): Terminated: ok {rc=0} 15:50:35.077604 bus /sierra_9: Setting Powered False 15:50:36.176366 bus /sierra_9: Setting Powered False 15:50:37.295426 bus /sierra_8: Setting Powered False 15:50:38.395445 bus /sierra_8: Setting Powered False 15:50:39.510810 bus /sierra_3: Setting Powered False 15:50:40.609110 bus /sierra_3: Setting Powered False 15:50:41.725426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:oc2g --------------------------------------------------------------------- 15:50:42.990884 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:50:42.995299 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 15:50:43.016230 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 15:50:43.055739 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 15:50:43.144445 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 15:50:43.165761 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 15:50:43.205273 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 15:50:43.794639 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 15:50:43.846458 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:43.857394 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:50:43.892689 tst cs_paging_gprs_active.py: using LAC 29002 15:50:44.012578 tst cs_paging_gprs_active.py: using RAC 187 15:50:44.132804 tst cs_paging_gprs_active.py: using CellId 29002 15:50:44.251534 tst cs_paging_gprs_active.py: using BVCI 29003 15:50:44.361741 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.372342 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.382832 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.393729 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.404249 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.414709 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.425244 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.435638 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.446197 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:50:44.560213 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:50:44.674761 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:50:44.874673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:50:45.174049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20471): Launched 15:50:45.433083 run iperf3-srv_10.42.42.10(pid=20472): Launched 15:50:45.544862 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:50:45.744599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:50:46.067844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20473): Launched 15:50:46.346440 run iperf3-srv_10.42.42.10(pid=20474): Launched 15:50:46.477538 tst cs_paging_gprs_active.py:38: start network... 15:50:46.681164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:47.155645 run create_hlr_db(pid=20475): Launched 15:50:47.302708 bus /sierra_2: Setting Powered False 15:50:48.363013 run create_hlr_db(pid=20475): Terminated: ok {rc=0} 15:50:48.798306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20477): Launched 15:50:49.116602 run osmo-hlr_10.42.42.2(pid=20478): Launched 15:50:49.237670 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:49.787101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20480): Launched 15:50:50.106093 run osmo-stp_10.42.42.5(pid=20481): Launched 15:50:50.226568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:50:50.774410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20483): Launched 15:50:50.895443 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:50:51.164917 run patchelf(pid=20484): Launched 15:50:51.342178 run osmo-stp_10.42.42.5(pid=20481): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20481)] 15:50:51.477426 run osmo-stp_10.42.42.5(pid=20481): stdout: | (launched: 2022-12-10_15:50:50.048097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:51.615594 run osmo-stp_10.42.42.5(pid=20481): stderr: | [0;m[38;5;43m20221210155050238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155050238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155050238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155050239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155050239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155050239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155050239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:51.753170 run osmo-stp_10.42.42.5(pid=20481): stdout: | (launched: 2022-12-10_15:50:50.048097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:51.884236 run osmo-stp_10.42.42.5(pid=20481): stderr: | [0;m[38;5;43m20221210155050238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155050238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155050238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155050239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155050239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155050239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155050239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:52.039968 run patchelf(pid=20484): Terminating (SIGINT) 15:50:52.219584 run patchelf(pid=20484): Terminated: ok {rc=0} 15:50:52.349079 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20481): Process ended prematurely: osmo-stp_10.42.42.5(pid=20481) [trial-2376↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20481)] [trial-2376↪gprs:oc2g↪cs_paging_gprs_active.py:38] 15:50:52.358900 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 15:50:52.387447 run osmo-hlr_10.42.42.2(pid=20478): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20478)] 15:50:52.437516 run osmo-hlr_10.42.42.2(pid=20478): stdout: | (launched: 2022-12-10_15:50:49.058988) 15:50:52.489380 run osmo-hlr_10.42.42.2(pid=20478): stderr: | [0;m[1;31m20221210155049256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155049256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155049256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155049256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155049256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155049256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155049268 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155049276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155049277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155049277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:52.541491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20471): Terminating (SIGTERM) 15:50:52.583080 run iperf3-srv_10.42.42.10(pid=20472): Terminating (SIGTERM) 15:50:52.624695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20473): Terminating (SIGTERM) 15:50:52.666545 run iperf3-srv_10.42.42.10(pid=20474): Terminating (SIGTERM) 15:50:52.708106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20477): Terminating (SIGTERM) 15:50:52.750030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20480): Terminating (SIGTERM) 15:50:52.791672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20483): Terminating (SIGTERM) 15:50:52.833763 --- ParallelTerminationStrategy: PID 20471 died... 15:50:52.853818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20471): Terminated: ok {rc=0} 15:50:52.899966 --- ParallelTerminationStrategy: PID 20472 died... 15:50:52.919357 run iperf3-srv_10.42.42.10(pid=20472): Terminated {rc=256} 15:50:52.965208 --- ParallelTerminationStrategy: PID 20473 died... 15:50:52.984498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20473): Terminated: ok {rc=0} 15:50:53.031243 --- ParallelTerminationStrategy: PID 20474 died... 15:50:53.050770 run iperf3-srv_10.42.42.10(pid=20474): Terminated {rc=256} 15:50:53.096469 --- ParallelTerminationStrategy: PID 20477 died... 15:50:53.115993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20477): Terminated: ok {rc=0} 15:50:53.161908 --- ParallelTerminationStrategy: PID 20480 died... 15:50:53.181441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20480): Terminated: ok {rc=0} 15:50:53.227219 --- ParallelTerminationStrategy: PID 20483 died... 15:50:53.246688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20483): Terminated: ok {rc=0} 15:50:53.333589 bus /gobi_0: Setting Powered False 15:50:54.433445 bus /gobi_0: Setting Powered False 15:50:55.549175 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g iperf3.py ---------------------------------------------- 15:50:56.692040 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:56.703156 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:50:56.738403 tst iperf3.py: using LAC 29003 15:50:56.856724 tst iperf3.py: using RAC 188 15:50:56.972845 tst iperf3.py: using CellId 29003 15:50:57.089855 tst iperf3.py: using BVCI 29004 15:50:57.198784 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:57.209333 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:57.219708 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:57.230460 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:57.240796 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:57.251314 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:57.262125 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:57.272641 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:57.283341 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:50:57.398054 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:50:57.599344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:50:57.898932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20486): Launched 15:50:58.158032 run iperf3-srv_10.42.42.10(pid=20487): Launched 15:50:58.269440 tst iperf3.py:8: start network... 15:50:58.469172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:58.928657 run create_hlr_db(pid=20488): Launched 15:50:59.041759 bus /gobi_6: Setting Powered False 15:51:00.101566 run create_hlr_db(pid=20488): Terminated: ok {rc=0} 15:51:00.538168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20490): Launched 15:51:00.877442 run osmo-hlr_10.42.42.2(pid=20491): Launched 15:51:01.126777 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:01.861138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20493): Launched 15:51:02.197129 run osmo-stp_10.42.42.5(pid=20494): Launched 15:51:02.338101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:51:02.891362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20496): Launched 15:51:03.015386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:51:03.285605 run patchelf(pid=20497): Launched 15:51:03.462803 run osmo-stp_10.42.42.5(pid=20494): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20494)] 15:51:03.598479 run osmo-stp_10.42.42.5(pid=20494): stdout: | (launched: 2022-12-10_15:51:02.124110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:03.736605 run osmo-stp_10.42.42.5(pid=20494): stderr: | [0;m[38;5;43m20221210155102341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155102341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155102342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155102342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155102342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155102343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155102343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:03.874265 run osmo-stp_10.42.42.5(pid=20494): stdout: | (launched: 2022-12-10_15:51:02.124110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:04.005998 run osmo-stp_10.42.42.5(pid=20494): stderr: | [0;m[38;5;43m20221210155102341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155102341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155102342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155102342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155102342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155102343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155102343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:04.162093 run patchelf(pid=20497): Terminating (SIGINT) 15:51:04.342038 run patchelf(pid=20497): Terminated: ok {rc=0} 15:51:04.471699 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20494): Process ended prematurely: osmo-stp_10.42.42.5(pid=20494) [trial-2376↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20494)] [trial-2376↪gprs:oc2g↪iperf3.py:8] 15:51:04.481767 tst iperf3.py:8: Test FAILED (7.8 sec) 15:51:04.510354 run osmo-hlr_10.42.42.2(pid=20491): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20491)] 15:51:04.560441 run osmo-hlr_10.42.42.2(pid=20491): stdout: | (launched: 2022-12-10_15:51:00.798821) 15:51:04.612489 run osmo-hlr_10.42.42.2(pid=20491): stderr: | [0;m[1;31m20221210155101220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155101220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155101221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155101221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155101221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155101222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155101247 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155101265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155101265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155101265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:04.664814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20486): Terminating (SIGTERM) 15:51:04.707356 run iperf3-srv_10.42.42.10(pid=20487): Terminating (SIGTERM) 15:51:04.749884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20490): Terminating (SIGTERM) 15:51:04.791955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20493): Terminating (SIGTERM) 15:51:04.833854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20496): Terminating (SIGTERM) 15:51:04.876081 --- ParallelTerminationStrategy: PID 20486 died... 15:51:04.896239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20486): Terminated: ok {rc=0} 15:51:04.943159 --- ParallelTerminationStrategy: PID 20487 died... 15:51:04.962715 run iperf3-srv_10.42.42.10(pid=20487): Terminated {rc=256} 15:51:05.009369 --- ParallelTerminationStrategy: PID 20490 died... 15:51:05.028802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20490): Terminated: ok {rc=0} 15:51:05.075416 --- ParallelTerminationStrategy: PID 20493 died... 15:51:05.094993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20493): Terminated: ok {rc=0} 15:51:05.141372 --- ParallelTerminationStrategy: PID 20496 died... 15:51:05.161032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20496): Terminated: ok {rc=0} 15:51:05.249181 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g iperf3m4.py ---------------------------------------------- 15:51:06.400128 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:06.411744 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:51:06.447341 tst iperf3m4.py: using LAC 29004 15:51:06.572523 tst iperf3m4.py: using RAC 189 15:51:06.699396 tst iperf3m4.py: using CellId 29004 15:51:06.819267 tst iperf3m4.py: using BVCI 29005 15:51:06.927700 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:06.938392 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:06.948910 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:06.959978 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:06.970840 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:06.981697 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:06.992505 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:07.003338 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:07.014176 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:51:07.127901 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:51:07.250344 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:51:07.363552 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:51:07.479185 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:51:07.695756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:08.016733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20498): Launched 15:51:08.293435 run iperf3-srv_10.42.42.10(pid=20499): Launched 15:51:08.412776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:51:08.628161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:08.947862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20500): Launched 15:51:09.224498 run iperf3-srv_10.42.42.10(pid=20501): Launched 15:51:09.343666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:51:09.557684 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:09.877194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20502): Launched 15:51:10.153578 run iperf3-srv_10.42.42.10(pid=20503): Launched 15:51:10.272780 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:51:10.487172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:10.806702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20504): Launched 15:51:11.082690 run iperf3-srv_10.42.42.10(pid=20505): Launched 15:51:11.201604 tst iperf3m4.py:8: start network... 15:51:11.415699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:11.909899 run create_hlr_db(pid=20506): Launched 15:51:12.039165 bus /gobi_6: Setting Powered False 15:51:13.099398 run create_hlr_db(pid=20506): Terminated: ok {rc=0} 15:51:13.542833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20508): Launched 15:51:13.861983 run osmo-hlr_10.42.42.2(pid=20509): Launched 15:51:13.982511 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:14.534180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20511): Launched 15:51:14.850946 run osmo-stp_10.42.42.5(pid=20512): Launched 15:51:14.971307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:51:15.524274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20514): Launched 15:51:15.646098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:51:15.947279 run patchelf(pid=20515): Launched 15:51:16.124196 run osmo-stp_10.42.42.5(pid=20512): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20512)] 15:51:16.256592 run osmo-stp_10.42.42.5(pid=20512): stdout: | (launched: 2022-12-10_15:51:14.793162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:16.392026 run osmo-stp_10.42.42.5(pid=20512): stderr: | [0;m[38;5;43m20221210155114979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155114979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155114980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155114980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155114981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155114981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155114981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:16.527661 run osmo-stp_10.42.42.5(pid=20512): stdout: | (launched: 2022-12-10_15:51:14.793162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:16.656279 run osmo-stp_10.42.42.5(pid=20512): stderr: | [0;m[38;5;43m20221210155114979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155114979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155114980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155114980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155114981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155114981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155114981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:16.810516 run patchelf(pid=20515): Terminating (SIGINT) 15:51:16.985921 run patchelf(pid=20515): Terminated: ok {rc=0} 15:51:17.113018 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20512): Process ended prematurely: osmo-stp_10.42.42.5(pid=20512) [trial-2376↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20512)] [trial-2376↪gprs:oc2g↪iperf3m4.py:8] 15:51:17.124550 tst iperf3m4.py:8: Test FAILED (10.8 sec) 15:51:17.155594 run osmo-hlr_10.42.42.2(pid=20509): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20509)] 15:51:17.206480 run osmo-hlr_10.42.42.2(pid=20509): stdout: | (launched: 2022-12-10_15:51:13.804038) 15:51:17.257070 run osmo-hlr_10.42.42.2(pid=20509): stderr: | [0;m[1;31m20221210155113999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155113999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155113999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155113999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155113999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155113999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155114011 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155114020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155114020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155114020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:17.308063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20498): Terminating (SIGTERM) 15:51:17.349061 run iperf3-srv_10.42.42.10(pid=20499): Terminating (SIGTERM) 15:51:17.389616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20500): Terminating (SIGTERM) 15:51:17.430403 run iperf3-srv_10.42.42.10(pid=20501): Terminating (SIGTERM) 15:51:17.471017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20502): Terminating (SIGTERM) 15:51:17.511767 run iperf3-srv_10.42.42.10(pid=20503): Terminating (SIGTERM) 15:51:17.552367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20504): Terminating (SIGTERM) 15:51:17.593064 run iperf3-srv_10.42.42.10(pid=20505): Terminating (SIGTERM) 15:51:17.633663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20508): Terminating (SIGTERM) 15:51:17.674261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20511): Terminating (SIGTERM) 15:51:17.714928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20514): Terminating (SIGTERM) 15:51:17.755920 --- ParallelTerminationStrategy: PID 20498 died... 15:51:17.775223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20498): Terminated: ok {rc=0} 15:51:17.820665 --- ParallelTerminationStrategy: PID 20499 died... 15:51:17.839366 run iperf3-srv_10.42.42.10(pid=20499): Terminated {rc=256} 15:51:17.883919 --- ParallelTerminationStrategy: PID 20500 died... 15:51:17.902703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20500): Terminated: ok {rc=0} 15:51:17.947144 --- ParallelTerminationStrategy: PID 20501 died... 15:51:17.965883 run iperf3-srv_10.42.42.10(pid=20501): Terminated {rc=256} 15:51:18.010207 --- ParallelTerminationStrategy: PID 20502 died... 15:51:18.029061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20502): Terminated: ok {rc=0} 15:51:18.073543 --- ParallelTerminationStrategy: PID 20503 died... 15:51:18.092364 run iperf3-srv_10.42.42.10(pid=20503): Terminated {rc=256} 15:51:18.137124 --- ParallelTerminationStrategy: PID 20504 died... 15:51:18.155872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20504): Terminated: ok {rc=0} 15:51:18.201212 --- ParallelTerminationStrategy: PID 20505 died... 15:51:18.220098 run iperf3-srv_10.42.42.10(pid=20505): Terminated {rc=256} 15:51:18.264915 --- ParallelTerminationStrategy: PID 20508 died... 15:51:18.283809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20508): Terminated: ok {rc=0} 15:51:18.328182 --- ParallelTerminationStrategy: PID 20511 died... 15:51:18.347137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20511): Terminated: ok {rc=0} 15:51:18.391722 --- ParallelTerminationStrategy: PID 20514 died... 15:51:18.410554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20514): Terminated: ok {rc=0} 15:51:18.495212 bus /gobi_4: Setting Powered False 15:51:19.593873 bus /gobi_4: Setting Powered False 15:51:20.712246 bus /gobi_1: Setting Powered False 15:51:21.810780 bus /gobi_1: Setting Powered False 15:51:22.924298 bus /gobi_0: Setting Powered False 15:51:24.023581 bus /gobi_0: Setting Powered False 15:51:25.142247 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g ping.py ---------------------------------------------- 15:51:26.244876 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:26.255911 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:51:26.291513 tst ping.py: using LAC 29005 15:51:26.409218 tst ping.py: using RAC 190 15:51:26.524432 tst ping.py: using CellId 29005 15:51:26.640711 tst ping.py: using BVCI 29006 15:51:26.748245 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:26.758862 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:26.769231 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:26.779811 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:26.790300 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:26.800785 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:26.811445 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:26.822426 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:51:26.934486 tst ping.py:19: start network... 15:51:27.134979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:27.594334 run create_hlr_db(pid=20516): Launched 15:51:27.706101 bus /gobi_6: Setting Powered False 15:51:28.765293 run create_hlr_db(pid=20516): Terminated: ok {rc=0} 15:51:29.199870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20518): Launched 15:51:29.517415 run osmo-hlr_10.42.42.2(pid=20519): Launched 15:51:29.639598 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:30.191249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20521): Launched 15:51:30.509756 run osmo-stp_10.42.42.5(pid=20522): Launched 15:51:30.631347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:51:31.185765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20524): Launched 15:51:31.314660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:51:31.579163 run patchelf(pid=20525): Launched 15:51:31.760531 run osmo-stp_10.42.42.5(pid=20522): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20522)] 15:51:31.892919 run osmo-stp_10.42.42.5(pid=20522): stdout: | (launched: 2022-12-10_15:51:30.451249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:32.025387 run osmo-stp_10.42.42.5(pid=20522): stderr: | [0;m[38;5;43m20221210155130643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155130643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155130643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155130644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155130644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155130644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155130644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:32.158615 run osmo-stp_10.42.42.5(pid=20522): stdout: | (launched: 2022-12-10_15:51:30.451249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:32.281912 run osmo-stp_10.42.42.5(pid=20522): stderr: | [0;m[38;5;43m20221210155130643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155130643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155130643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155130644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155130644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155130644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155130644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:32.427363 run patchelf(pid=20525): Terminating (SIGINT) 15:51:32.594704 run patchelf(pid=20525): Terminated: ok {rc=0} 15:51:32.715286 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20522): Process ended prematurely: osmo-stp_10.42.42.5(pid=20522) [trial-2376↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20522)] [trial-2376↪gprs:oc2g↪ping.py:22] 15:51:32.724281 tst ping.py:22: Test FAILED (6.5 sec) 15:51:32.751924 run osmo-hlr_10.42.42.2(pid=20519): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20519)] 15:51:32.800717 run osmo-hlr_10.42.42.2(pid=20519): stdout: | (launched: 2022-12-10_15:51:29.459210) 15:51:32.850586 run osmo-hlr_10.42.42.2(pid=20519): stderr: | [0;m[1;31m20221210155129658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155129658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155129658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155129658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155129658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155129658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155129673 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155129682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155129683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155129683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:32.900857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20518): Terminating (SIGTERM) 15:51:32.941457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20521): Terminating (SIGTERM) 15:51:32.981949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20524): Terminating (SIGTERM) 15:51:33.022772 --- ParallelTerminationStrategy: PID 20518 died... 15:51:33.042175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20518): Terminated: ok {rc=0} 15:51:33.087285 --- ParallelTerminationStrategy: PID 20521 died... 15:51:33.106472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20521): Terminated: ok {rc=0} 15:51:33.151633 --- ParallelTerminationStrategy: PID 20524 died... 15:51:33.170476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20524): Terminated: ok {rc=0} 15:51:33.258207 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 15:51:34.347420 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:34.359069 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:51:34.395972 tst ping_idle_ping.py: using LAC 29006 15:51:34.526345 tst ping_idle_ping.py: using RAC 191 15:51:34.650762 tst ping_idle_ping.py: using CellId 29006 15:51:34.773745 tst ping_idle_ping.py: using BVCI 29007 15:51:34.889674 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:34.900728 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:34.911880 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:34.922758 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:34.934083 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:34.945092 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:34.956193 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:34.967158 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:51:35.081807 tst ping_idle_ping.py:24: start network... 15:51:35.281782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:35.744942 run create_hlr_db(pid=20526): Launched 15:51:35.859692 bus /gobi_6: Setting Powered False 15:51:36.920141 run create_hlr_db(pid=20526): Terminated: ok {rc=0} 15:51:37.356475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20528): Launched 15:51:37.675487 run osmo-hlr_10.42.42.2(pid=20529): Launched 15:51:37.796355 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:38.348469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20531): Launched 15:51:38.666696 run osmo-stp_10.42.42.5(pid=20532): Launched 15:51:38.788735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:51:39.339496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20534): Launched 15:51:39.460897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:51:39.730733 run patchelf(pid=20535): Launched 15:51:39.906524 run osmo-stp_10.42.42.5(pid=20532): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20532)] 15:51:40.041649 run osmo-stp_10.42.42.5(pid=20532): stdout: | (launched: 2022-12-10_15:51:38.608021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:40.177873 run osmo-stp_10.42.42.5(pid=20532): stderr: | [0;m[38;5;43m20221210155138801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155138801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155138801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155138802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155138802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155138802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155138802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:40.314158 run osmo-stp_10.42.42.5(pid=20532): stdout: | (launched: 2022-12-10_15:51:38.608021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:40.444555 run osmo-stp_10.42.42.5(pid=20532): stderr: | [0;m[38;5;43m20221210155138801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155138801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155138801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155138802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155138802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155138802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155138802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:40.599474 run patchelf(pid=20535): Terminating (SIGINT) 15:51:40.777901 run patchelf(pid=20535): Terminated: ok {rc=0} 15:51:40.905976 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20532): Process ended prematurely: osmo-stp_10.42.42.5(pid=20532) [trial-2376↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20532)] [trial-2376↪gprs:oc2g↪ping_idle_ping.py:27] 15:51:40.915388 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 15:51:40.943573 run osmo-hlr_10.42.42.2(pid=20529): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20529)] 15:51:40.993411 run osmo-hlr_10.42.42.2(pid=20529): stdout: | (launched: 2022-12-10_15:51:37.617312) 15:51:41.045377 run osmo-hlr_10.42.42.2(pid=20529): stderr: | [0;m[1;31m20221210155137815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155137815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155137815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155137815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155137815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155137815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155137830 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155137838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155137839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155137839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:41.097590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20528): Terminating (SIGTERM) 15:51:41.139141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20531): Terminating (SIGTERM) 15:51:41.180941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20534): Terminating (SIGTERM) 15:51:41.223066 --- ParallelTerminationStrategy: PID 20528 died... 15:51:41.243051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20528): Terminated: ok {rc=0} 15:51:41.289301 --- ParallelTerminationStrategy: PID 20531 died... 15:51:41.308838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20531): Terminated: ok {rc=0} 15:51:41.355207 --- ParallelTerminationStrategy: PID 20534 died... 15:51:41.374788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20534): Terminated: ok {rc=0} 15:51:41.464340 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 15:51:42.762132 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:51:42.768062 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 15:51:42.789523 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 15:51:42.829284 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 15:51:42.918712 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 15:51:42.939773 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 15:51:42.979792 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 15:51:43.574909 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 15:51:43.626489 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:43.637620 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:51:43.676670 tst cs_paging_gprs_active.py: using LAC 29007 15:51:43.800638 tst cs_paging_gprs_active.py: using RAC 192 15:51:43.924647 tst cs_paging_gprs_active.py: using CellId 29007 15:51:44.048907 tst cs_paging_gprs_active.py: using BVCI 29008 15:51:44.164252 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.175959 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.187511 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.199018 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.210006 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.220896 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.232153 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.243180 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.254433 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:51:44.368211 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:51:44.482319 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:51:44.683868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:44.983422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20540): Launched 15:51:45.243675 run iperf3-srv_10.42.42.10(pid=20541): Launched 15:51:45.355152 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:51:45.554574 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:45.861743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20542): Launched 15:51:46.171089 run iperf3-srv_10.42.42.10(pid=20543): Launched 15:51:46.304446 tst cs_paging_gprs_active.py:38: start network... 15:51:46.527316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:47.037473 run create_hlr_db(pid=20544): Launched 15:51:47.197011 bus /gobi_6: Setting Powered False 15:51:48.259927 run create_hlr_db(pid=20544): Terminated: ok {rc=0} 15:51:48.703487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20546): Launched 15:51:49.020349 run osmo-hlr_10.42.42.2(pid=20547): Launched 15:51:49.140345 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:49.684869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20549): Launched 15:51:50.001381 run osmo-stp_10.42.42.5(pid=20550): Launched 15:51:50.122551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:51:50.670462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20552): Launched 15:51:50.791183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:51:51.059358 run patchelf(pid=20553): Launched 15:51:51.235532 run osmo-stp_10.42.42.5(pid=20550): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20550)] 15:51:51.370400 run osmo-stp_10.42.42.5(pid=20550): stdout: | (launched: 2022-12-10_15:51:49.943739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:51.506956 run osmo-stp_10.42.42.5(pid=20550): stderr: | [0;m[38;5;43m20221210155150136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155150136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155150136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155150137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155150139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155150139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155150139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:51.643675 run osmo-stp_10.42.42.5(pid=20550): stdout: | (launched: 2022-12-10_15:51:49.943739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:51.773730 run osmo-stp_10.42.42.5(pid=20550): stderr: | [0;m[38;5;43m20221210155150136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155150136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155150136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155150137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155150139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155150139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155150139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:51.928171 run patchelf(pid=20553): Terminating (SIGINT) 15:51:52.107709 run patchelf(pid=20553): Terminated: ok {rc=0} 15:51:52.236384 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20550): Process ended prematurely: osmo-stp_10.42.42.5(pid=20550) [trial-2376↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20550)] [trial-2376↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 15:51:52.246493 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 15:51:52.274887 run osmo-hlr_10.42.42.2(pid=20547): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20547)] 15:51:52.324905 run osmo-hlr_10.42.42.2(pid=20547): stdout: | (launched: 2022-12-10_15:51:48.962320) 15:51:52.376689 run osmo-hlr_10.42.42.2(pid=20547): stderr: | [0;m[1;31m20221210155149160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155149160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155149160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155149160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155149160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155149160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155149174 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155149182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155149182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155149182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:52.428862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20540): Terminating (SIGTERM) 15:51:52.470739 run iperf3-srv_10.42.42.10(pid=20541): Terminating (SIGTERM) 15:51:52.512498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20542): Terminating (SIGTERM) 15:51:52.554312 run iperf3-srv_10.42.42.10(pid=20543): Terminating (SIGTERM) 15:51:52.596009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20546): Terminating (SIGTERM) 15:51:52.637940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20549): Terminating (SIGTERM) 15:51:52.679905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20552): Terminating (SIGTERM) 15:51:52.721946 --- ParallelTerminationStrategy: PID 20540 died... 15:51:52.741916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20540): Terminated: ok {rc=0} 15:51:52.788595 --- ParallelTerminationStrategy: PID 20541 died... 15:51:52.808099 run iperf3-srv_10.42.42.10(pid=20541): Terminated {rc=256} 15:51:52.854006 --- ParallelTerminationStrategy: PID 20542 died... 15:51:52.873387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20542): Terminated: ok {rc=0} 15:51:52.919388 --- ParallelTerminationStrategy: PID 20543 died... 15:51:52.938821 run iperf3-srv_10.42.42.10(pid=20543): Terminated {rc=256} 15:51:52.984777 --- ParallelTerminationStrategy: PID 20546 died... 15:51:53.004148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20546): Terminated: ok {rc=0} 15:51:53.050428 --- ParallelTerminationStrategy: PID 20549 died... 15:51:53.069888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20549): Terminated: ok {rc=0} 15:51:53.115781 --- ParallelTerminationStrategy: PID 20552 died... 15:51:53.135482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20552): Terminated: ok {rc=0} 15:51:53.223251 bus /gobi_0: Setting Powered False 15:51:54.323279 bus /gobi_0: Setting Powered False 15:51:55.438618 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 15:51:56.585648 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:56.597865 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:51:56.636084 tst iperf3.py: using LAC 29008 15:51:56.760099 tst iperf3.py: using RAC 193 15:51:56.889289 tst iperf3.py: using CellId 29008 15:51:57.012716 tst iperf3.py: using BVCI 29009 15:51:57.128231 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:57.139446 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:57.150598 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:57.161873 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:57.172725 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:57.183727 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:57.194859 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:57.205855 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:57.216940 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:51:57.333110 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:51:57.533248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:57.832102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20554): Launched 15:51:58.090241 run iperf3-srv_10.42.42.10(pid=20555): Launched 15:51:58.201349 tst iperf3.py:8: start network... 15:51:58.399433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:58.857960 run create_hlr_db(pid=20556): Launched 15:51:58.971317 bus /gobi_6: Setting Powered False 15:52:00.030910 run create_hlr_db(pid=20556): Terminated: ok {rc=0} 15:52:00.465987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20558): Launched 15:52:00.781332 run osmo-hlr_10.42.42.2(pid=20559): Launched 15:52:00.978760 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:01.638648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20561): Launched 15:52:01.971074 run osmo-stp_10.42.42.5(pid=20562): Launched 15:52:02.250768 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:02.801154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20564): Launched 15:52:02.914628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:03.165981 run patchelf(pid=20565): Launched 15:52:03.330593 run osmo-stp_10.42.42.5(pid=20562): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20562)] 15:52:03.457219 run osmo-stp_10.42.42.5(pid=20562): stdout: | (launched: 2022-12-10_15:52:01.907706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:03.585976 run osmo-stp_10.42.42.5(pid=20562): stderr: | [0;m[38;5;43m20221210155202131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155202131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155202132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155202132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155202132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155202133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155202133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:03.714660 run osmo-stp_10.42.42.5(pid=20562): stdout: | (launched: 2022-12-10_15:52:01.907706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:03.837565 run osmo-stp_10.42.42.5(pid=20562): stderr: | [0;m[38;5;43m20221210155202131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155202131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155202132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155202132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155202132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155202133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155202133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:03.982349 run patchelf(pid=20565): Terminating (SIGINT) 15:52:04.150945 run patchelf(pid=20565): Terminated: ok {rc=0} 15:52:04.272308 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20562): Process ended prematurely: osmo-stp_10.42.42.5(pid=20562) [trial-2376↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20562)] [trial-2376↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 15:52:04.281979 tst iperf3.py:8: Test FAILED (7.7 sec) 15:52:04.309293 run osmo-hlr_10.42.42.2(pid=20559): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20559)] 15:52:04.357635 run osmo-hlr_10.42.42.2(pid=20559): stdout: | (launched: 2022-12-10_15:52:00.723756) 15:52:04.407270 run osmo-hlr_10.42.42.2(pid=20559): stderr: | [0;m[1;31m20221210155200973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155200973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155200973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155200973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155200973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155200973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155200986 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155201000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155201000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155201000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:04.457816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20554): Terminating (SIGTERM) 15:52:04.498308 run iperf3-srv_10.42.42.10(pid=20555): Terminating (SIGTERM) 15:52:04.538609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20558): Terminating (SIGTERM) 15:52:04.579509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20561): Terminating (SIGTERM) 15:52:04.620019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20564): Terminating (SIGTERM) 15:52:04.660333 --- ParallelTerminationStrategy: PID 20554 died... 15:52:04.679502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20554): Terminated: ok {rc=0} 15:52:04.724597 --- ParallelTerminationStrategy: PID 20555 died... 15:52:04.743294 run iperf3-srv_10.42.42.10(pid=20555): Terminated {rc=256} 15:52:04.787748 --- ParallelTerminationStrategy: PID 20558 died... 15:52:04.806524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20558): Terminated: ok {rc=0} 15:52:04.851043 --- ParallelTerminationStrategy: PID 20561 died... 15:52:04.869825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20561): Terminated: ok {rc=0} 15:52:04.914451 --- ParallelTerminationStrategy: PID 20564 died... 15:52:04.933275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20564): Terminated: ok {rc=0} 15:52:05.019859 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 15:52:06.167822 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:06.179556 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:52:06.221551 tst iperf3m4.py: using LAC 29009 15:52:06.357112 tst iperf3m4.py: using RAC 194 15:52:06.483931 tst iperf3m4.py: using CellId 29009 15:52:06.608339 tst iperf3m4.py: using BVCI 29010 15:52:06.725662 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:06.737117 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:06.748260 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:06.759971 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:06.771623 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:06.783087 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:06.794811 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:06.806289 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:06.817820 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:52:06.936575 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:52:07.051158 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:52:07.170278 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:52:07.284238 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:52:07.484745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:07.785738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20566): Launched 15:52:08.044521 run iperf3-srv_10.42.42.10(pid=20567): Launched 15:52:08.155640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:52:08.355066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:08.653744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20568): Launched 15:52:08.912570 run iperf3-srv_10.42.42.10(pid=20569): Launched 15:52:09.023605 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:52:09.222669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:09.521539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20570): Launched 15:52:09.781123 run iperf3-srv_10.42.42.10(pid=20571): Launched 15:52:09.892500 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:52:10.091676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:10.391427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20572): Launched 15:52:10.650628 run iperf3-srv_10.42.42.10(pid=20573): Launched 15:52:10.761768 tst iperf3m4.py:8: start network... 15:52:10.961258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:11.422138 run create_hlr_db(pid=20574): Launched 15:52:11.536169 bus /gobi_6: Setting Powered False 15:52:12.595214 run create_hlr_db(pid=20574): Terminated: ok {rc=0} 15:52:13.030604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20576): Launched 15:52:13.349361 run osmo-hlr_10.42.42.2(pid=20577): Launched 15:52:13.470643 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:14.021608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20579): Launched 15:52:14.339919 run osmo-stp_10.42.42.5(pid=20580): Launched 15:52:14.461465 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:15.010127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20582): Launched 15:52:15.133021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:15.402830 run patchelf(pid=20583): Launched 15:52:15.579267 run osmo-stp_10.42.42.5(pid=20580): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20580)] 15:52:15.713923 run osmo-stp_10.42.42.5(pid=20580): stdout: | (launched: 2022-12-10_15:52:14.281696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:15.850739 run osmo-stp_10.42.42.5(pid=20580): stderr: | [0;m[38;5;43m20221210155214471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155214471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155214471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155214472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155214472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155214472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155214472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:15.989890 run osmo-stp_10.42.42.5(pid=20580): stdout: | (launched: 2022-12-10_15:52:14.281696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:16.122174 run osmo-stp_10.42.42.5(pid=20580): stderr: | [0;m[38;5;43m20221210155214471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155214471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155214471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155214472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155214472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155214472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155214472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:16.279279 run patchelf(pid=20583): Terminating (SIGINT) 15:52:16.462274 run patchelf(pid=20583): Terminated: ok {rc=0} 15:52:16.593318 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20580): Process ended prematurely: osmo-stp_10.42.42.5(pid=20580) [trial-2376↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20580)] [trial-2376↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 15:52:16.603961 tst iperf3m4.py:8: Test FAILED (10.5 sec) 15:52:16.633187 run osmo-hlr_10.42.42.2(pid=20577): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20577)] 15:52:16.684100 run osmo-hlr_10.42.42.2(pid=20577): stdout: | (launched: 2022-12-10_15:52:13.291233) 15:52:16.736349 run osmo-hlr_10.42.42.2(pid=20577): stderr: | [0;m[1;31m20221210155213488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155213488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155213488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155213488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155213488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155213488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155213501 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155213509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155213509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155213509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:16.789366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20566): Terminating (SIGTERM) 15:52:16.832306 run iperf3-srv_10.42.42.10(pid=20567): Terminating (SIGTERM) 15:52:16.877625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20568): Terminating (SIGTERM) 15:52:16.920886 run iperf3-srv_10.42.42.10(pid=20569): Terminating (SIGTERM) 15:52:16.966047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20570): Terminating (SIGTERM) 15:52:17.009199 run iperf3-srv_10.42.42.10(pid=20571): Terminating (SIGTERM) 15:52:17.054875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20572): Terminating (SIGTERM) 15:52:17.098285 run iperf3-srv_10.42.42.10(pid=20573): Terminating (SIGTERM) 15:52:17.143413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20576): Terminating (SIGTERM) 15:52:17.185866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20579): Terminating (SIGTERM) 15:52:17.227969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20582): Terminating (SIGTERM) 15:52:17.269720 --- ParallelTerminationStrategy: PID 20566 died... 15:52:17.289507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20566): Terminated: ok {rc=0} 15:52:17.335692 --- ParallelTerminationStrategy: PID 20567 died... 15:52:17.355021 run iperf3-srv_10.42.42.10(pid=20567): Terminated {rc=256} 15:52:17.400798 --- ParallelTerminationStrategy: PID 20568 died... 15:52:17.420567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20568): Terminated: ok {rc=0} 15:52:17.466319 --- ParallelTerminationStrategy: PID 20569 died... 15:52:17.485668 run iperf3-srv_10.42.42.10(pid=20569): Terminated {rc=256} 15:52:17.531137 --- ParallelTerminationStrategy: PID 20570 died... 15:52:17.550515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20570): Terminated: ok {rc=0} 15:52:17.596222 --- ParallelTerminationStrategy: PID 20571 died... 15:52:17.615529 run iperf3-srv_10.42.42.10(pid=20571): Terminated {rc=256} 15:52:17.661117 --- ParallelTerminationStrategy: PID 20572 died... 15:52:17.680289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20572): Terminated: ok {rc=0} 15:52:17.725800 --- ParallelTerminationStrategy: PID 20573 died... 15:52:17.745143 run iperf3-srv_10.42.42.10(pid=20573): Terminated {rc=256} 15:52:17.790469 --- ParallelTerminationStrategy: PID 20576 died... 15:52:17.809769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20576): Terminated: ok {rc=0} 15:52:17.855754 --- ParallelTerminationStrategy: PID 20579 died... 15:52:17.875056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20579): Terminated: ok {rc=0} 15:52:17.921145 --- ParallelTerminationStrategy: PID 20582 died... 15:52:17.940732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20582): Terminated: ok {rc=0} 15:52:18.029233 bus /gobi_4: Setting Powered False 15:52:19.129848 bus /gobi_4: Setting Powered False 15:52:20.247886 bus /gobi_1: Setting Powered False 15:52:21.346940 bus /gobi_1: Setting Powered False 15:52:22.462788 bus /gobi_0: Setting Powered False 15:52:23.562374 bus /gobi_0: Setting Powered False 15:52:24.678173 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 15:52:25.781505 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:25.793269 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:52:25.830597 tst ping.py: using LAC 29010 15:52:25.955388 tst ping.py: using RAC 195 15:52:26.078600 tst ping.py: using CellId 29010 15:52:26.202282 tst ping.py: using BVCI 29011 15:52:26.315989 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:26.327556 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:26.339175 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:26.350850 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:26.362275 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:26.373678 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:26.385790 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:26.396783 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:52:26.512172 tst ping.py:19: start network... 15:52:26.708750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:27.162019 run create_hlr_db(pid=20584): Launched 15:52:27.273415 bus /gobi_6: Setting Powered False 15:52:28.332463 run create_hlr_db(pid=20584): Terminated: ok {rc=0} 15:52:28.761669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Launched 15:52:29.073179 run osmo-hlr_10.42.42.2(pid=20587): Launched 15:52:29.192620 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:29.734185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Launched 15:52:30.045579 run osmo-stp_10.42.42.5(pid=20590): Launched 15:52:30.164914 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:30.706016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20592): Launched 15:52:30.824750 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:31.109754 run patchelf(pid=20593): Launched 15:52:31.291406 run osmo-stp_10.42.42.5(pid=20590): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] 15:52:31.426444 run osmo-stp_10.42.42.5(pid=20590): stdout: | (launched: 2022-12-10_15:52:29.988352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:31.561935 run osmo-stp_10.42.42.5(pid=20590): stderr: | [0;m[38;5;43m20221210155230179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155230179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155230179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155230180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155230180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155230180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155230180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:31.698314 run osmo-stp_10.42.42.5(pid=20590): stdout: | (launched: 2022-12-10_15:52:29.988352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:31.830979 run osmo-stp_10.42.42.5(pid=20590): stderr: | [0;m[38;5;43m20221210155230179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155230179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155230179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155230180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155230180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155230180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155230180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:31.984827 run patchelf(pid=20593): Terminating (SIGINT) 15:52:32.163224 run patchelf(pid=20593): Terminated: ok {rc=0} 15:52:32.289750 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20590): Process ended prematurely: osmo-stp_10.42.42.5(pid=20590) [trial-2376↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] [trial-2376↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 15:52:32.299164 tst ping.py:22: Test FAILED (6.5 sec) 15:52:32.327179 run osmo-hlr_10.42.42.2(pid=20587): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20587)] 15:52:32.378084 run osmo-hlr_10.42.42.2(pid=20587): stdout: | (launched: 2022-12-10_15:52:29.015628) 15:52:32.430036 run osmo-hlr_10.42.42.2(pid=20587): stderr: | [0;m[1;31m20221210155229213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155229213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155229213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155229213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155229213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155229213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155229226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155229234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155229234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155229234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:32.482162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Terminating (SIGTERM) 15:52:32.523964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Terminating (SIGTERM) 15:52:32.565919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20592): Terminating (SIGTERM) 15:52:32.608143 --- ParallelTerminationStrategy: PID 20586 died... 15:52:32.628218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Terminated: ok {rc=0} 15:52:32.674671 --- ParallelTerminationStrategy: PID 20589 died... 15:52:32.694263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Terminated: ok {rc=0} 15:52:32.740359 --- ParallelTerminationStrategy: PID 20592 died... 15:52:32.759986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20592): Terminated: ok {rc=0} 15:52:32.848769 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 15:52:33.936524 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:33.948498 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:52:33.988343 tst ping_idle_ping.py: using LAC 29011 15:52:34.112655 tst ping_idle_ping.py: using RAC 196 15:52:34.237101 tst ping_idle_ping.py: using CellId 29011 15:52:34.359811 tst ping_idle_ping.py: using BVCI 29012 15:52:34.475734 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:34.486928 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:34.497992 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:34.509076 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:34.519963 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:34.530902 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:34.542029 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:34.553119 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:52:34.669428 tst ping_idle_ping.py:24: start network... 15:52:34.880412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:35.368870 run create_hlr_db(pid=20594): Launched 15:52:35.495707 bus /gobi_6: Setting Powered False 15:52:36.557955 run create_hlr_db(pid=20594): Terminated: ok {rc=0} 15:52:36.998192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20596): Launched 15:52:37.312570 run osmo-hlr_10.42.42.2(pid=20597): Launched 15:52:37.432616 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:37.977373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20599): Launched 15:52:38.293657 run osmo-stp_10.42.42.5(pid=20600): Launched 15:52:38.414293 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:38.958986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20602): Launched 15:52:39.078814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:39.345056 run patchelf(pid=20603): Launched 15:52:39.519084 run osmo-stp_10.42.42.5(pid=20600): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20600)] 15:52:39.652530 run osmo-stp_10.42.42.5(pid=20600): stdout: | (launched: 2022-12-10_15:52:38.235911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:39.787470 run osmo-stp_10.42.42.5(pid=20600): stderr: | [0;m[38;5;43m20221210155238427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155238428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155238428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155238428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155238431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155238431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155238431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:39.922475 run osmo-stp_10.42.42.5(pid=20600): stdout: | (launched: 2022-12-10_15:52:38.235911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:40.052621 run osmo-stp_10.42.42.5(pid=20600): stderr: | [0;m[38;5;43m20221210155238427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155238428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155238428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155238428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155238431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155238431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155238431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:40.205921 run patchelf(pid=20603): Terminating (SIGINT) 15:52:40.382771 run patchelf(pid=20603): Terminated: ok {rc=0} 15:52:40.510711 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20600): Process ended prematurely: osmo-stp_10.42.42.5(pid=20600) [trial-2376↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20600)] [trial-2376↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 15:52:40.520228 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 15:52:40.548503 run osmo-hlr_10.42.42.2(pid=20597): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20597)] 15:52:40.599081 run osmo-hlr_10.42.42.2(pid=20597): stdout: | (launched: 2022-12-10_15:52:37.255183) 15:52:40.651073 run osmo-hlr_10.42.42.2(pid=20597): stderr: | [0;m[1;31m20221210155237452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155237452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155237452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155237452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155237452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155237452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155237466 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155237474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155237474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155237474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:40.703480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20596): Terminating (SIGTERM) 15:52:40.745713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20599): Terminating (SIGTERM) 15:52:40.788033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20602): Terminating (SIGTERM) 15:52:40.831018 --- ParallelTerminationStrategy: PID 20596 died... 15:52:40.851057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20596): Terminated: ok {rc=0} 15:52:40.898123 --- ParallelTerminationStrategy: PID 20599 died... 15:52:40.918019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20599): Terminated: ok {rc=0} 15:52:40.964862 --- ParallelTerminationStrategy: PID 20602 died... 15:52:40.984710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20602): Terminated: ok {rc=0} 15:52:41.074318 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 15:52:42.365312 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:52:42.371308 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 15:52:42.392337 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 15:52:42.432567 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 15:52:42.519321 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 15:52:42.539883 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 15:52:42.579148 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 15:52:43.170738 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 15:52:43.220663 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.231508 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:52:43.288095 tst cs_paging_gprs_active.py: using LAC 29012 15:52:43.411268 tst cs_paging_gprs_active.py: using RAC 197 15:52:43.529422 tst cs_paging_gprs_active.py: using CellId 29012 15:52:43.657858 tst cs_paging_gprs_active.py: using BVCI 29013 15:52:43.773765 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.785209 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.796265 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.807356 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.818417 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.829576 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.840715 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.851769 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.862995 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:52:43.981416 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:52:44.099491 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:52:44.317281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:44.640232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20607): Launched 15:52:44.918196 run iperf3-srv_10.42.42.10(pid=20608): Launched 15:52:45.037586 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:52:45.254595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:45.575787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20609): Launched 15:52:45.867641 run iperf3-srv_10.42.42.10(pid=20610): Launched 15:52:45.999419 tst cs_paging_gprs_active.py:38: start network... 15:52:46.208406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:46.692413 run create_hlr_db(pid=20611): Launched 15:52:46.846975 bus /gobi_6: Setting Powered False 15:52:47.906919 run create_hlr_db(pid=20611): Terminated: ok {rc=0} 15:52:48.324628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20613): Launched 15:52:48.625037 run osmo-hlr_10.42.42.2(pid=20614): Launched 15:52:48.739146 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:49.253378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20616): Launched 15:52:49.575138 run osmo-stp_10.42.42.5(pid=20617): Launched 15:52:49.696736 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:50.250232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20619): Launched 15:52:50.371720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:50.642156 run patchelf(pid=20620): Launched 15:52:50.818969 run osmo-stp_10.42.42.5(pid=20617): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20617)] 15:52:50.954148 run osmo-stp_10.42.42.5(pid=20617): stdout: | (launched: 2022-12-10_15:52:49.516143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:51.091850 run osmo-stp_10.42.42.5(pid=20617): stderr: | [0;m[38;5;43m20221210155249707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155249707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155249707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155249708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155249710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155249710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155249710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:51.229508 run osmo-stp_10.42.42.5(pid=20617): stdout: | (launched: 2022-12-10_15:52:49.516143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:51.360294 run osmo-stp_10.42.42.5(pid=20617): stderr: | [0;m[38;5;43m20221210155249707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155249707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155249707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155249708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155249710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155249710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155249710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:51.515307 run patchelf(pid=20620): Terminating (SIGINT) 15:52:51.694527 run patchelf(pid=20620): Terminated: ok {rc=0} 15:52:51.823980 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20617): Process ended prematurely: osmo-stp_10.42.42.5(pid=20617) [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20617)] [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 15:52:51.833892 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 15:52:51.862385 run osmo-hlr_10.42.42.2(pid=20614): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20614)] 15:52:51.912259 run osmo-hlr_10.42.42.2(pid=20614): stdout: | (launched: 2022-12-10_15:52:48.569990) 15:52:51.964025 run osmo-hlr_10.42.42.2(pid=20614): stderr: | [0;m[1;31m20221210155248744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155248744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155248745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155248745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155248745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155248745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155248757 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155248765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155248766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155248766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:52.016251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20607): Terminating (SIGTERM) 15:52:52.058675 run iperf3-srv_10.42.42.10(pid=20608): Terminating (SIGTERM) 15:52:52.100749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20609): Terminating (SIGTERM) 15:52:52.143295 run iperf3-srv_10.42.42.10(pid=20610): Terminating (SIGTERM) 15:52:52.186548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20613): Terminating (SIGTERM) 15:52:52.228785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20616): Terminating (SIGTERM) 15:52:52.270579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20619): Terminating (SIGTERM) 15:52:52.312475 --- ParallelTerminationStrategy: PID 20607 died... 15:52:52.332329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20607): Terminated: ok {rc=0} 15:52:52.378111 --- ParallelTerminationStrategy: PID 20608 died... 15:52:52.397320 run iperf3-srv_10.42.42.10(pid=20608): Terminated {rc=256} 15:52:52.442771 --- ParallelTerminationStrategy: PID 20609 died... 15:52:52.462001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20609): Terminated: ok {rc=0} 15:52:52.507478 --- ParallelTerminationStrategy: PID 20610 died... 15:52:52.526773 run iperf3-srv_10.42.42.10(pid=20610): Terminated {rc=256} 15:52:52.572883 --- ParallelTerminationStrategy: PID 20613 died... 15:52:52.592731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20613): Terminated: ok {rc=0} 15:52:52.638070 --- ParallelTerminationStrategy: PID 20616 died... 15:52:52.657337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20616): Terminated: ok {rc=0} 15:52:52.702726 --- ParallelTerminationStrategy: PID 20619 died... 15:52:52.721986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20619): Terminated: ok {rc=0} 15:52:52.808235 bus /gobi_0: Setting Powered False 15:52:53.907002 bus /gobi_0: Setting Powered False 15:52:55.023257 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 15:52:56.169959 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:56.181401 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:52:56.239994 tst iperf3.py: using LAC 29013 15:52:56.358854 tst iperf3.py: using RAC 198 15:52:56.476788 tst iperf3.py: using CellId 29013 15:52:56.594590 tst iperf3.py: using BVCI 29014 15:52:56.704218 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:56.715024 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:56.725663 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:56.736366 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:56.747087 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:56.757867 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:56.768712 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:56.779478 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:56.790503 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:52:56.907443 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:52:57.123749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:57.443592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20621): Launched 15:52:57.720020 run iperf3-srv_10.42.42.10(pid=20622): Launched 15:52:57.838742 tst iperf3.py:8: start network... 15:52:58.052850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:58.544918 run create_hlr_db(pid=20623): Launched 15:52:58.674158 bus /gobi_6: Setting Powered False 15:52:59.737405 run create_hlr_db(pid=20623): Terminated: ok {rc=0} 15:53:00.179096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20625): Launched 15:53:00.495467 run osmo-hlr_10.42.42.2(pid=20626): Launched 15:53:00.615933 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:01.190091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20628): Launched 15:53:01.517721 run osmo-stp_10.42.42.5(pid=20629): Launched 15:53:01.756316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:02.418224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20631): Launched 15:53:02.533081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:02.785882 run patchelf(pid=20632): Launched 15:53:02.951150 run osmo-stp_10.42.42.5(pid=20629): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20629)] 15:53:03.077847 run osmo-stp_10.42.42.5(pid=20629): stdout: | (launched: 2022-12-10_15:53:01.451084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:03.206728 run osmo-stp_10.42.42.5(pid=20629): stderr: | [0;m[38;5;43m20221210155301790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155301790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155301790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155301790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155301791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155301791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155301791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:03.335442 run osmo-stp_10.42.42.5(pid=20629): stdout: | (launched: 2022-12-10_15:53:01.451084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:03.458161 run osmo-stp_10.42.42.5(pid=20629): stderr: | [0;m[38;5;43m20221210155301790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155301790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155301790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155301790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155301791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155301791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155301791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:03.603224 run patchelf(pid=20632): Terminating (SIGINT) 15:53:03.771526 run patchelf(pid=20632): Terminated: ok {rc=0} 15:53:03.893436 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20629): Process ended prematurely: osmo-stp_10.42.42.5(pid=20629) [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20629)] [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 15:53:03.902859 tst iperf3.py:8: Test FAILED (7.8 sec) 15:53:03.930500 run osmo-hlr_10.42.42.2(pid=20626): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20626)] 15:53:03.978454 run osmo-hlr_10.42.42.2(pid=20626): stdout: | (launched: 2022-12-10_15:53:00.437429) 15:53:04.028368 run osmo-hlr_10.42.42.2(pid=20626): stderr: | [0;m[1;31m20221210155300637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155300637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155300637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155300637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155300637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155300637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155300650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155300658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155300659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155300659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:04.078598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20621): Terminating (SIGTERM) 15:53:04.118968 run iperf3-srv_10.42.42.10(pid=20622): Terminating (SIGTERM) 15:53:04.159087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20625): Terminating (SIGTERM) 15:53:04.199347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20628): Terminating (SIGTERM) 15:53:04.239476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20631): Terminating (SIGTERM) 15:53:04.279588 --- ParallelTerminationStrategy: PID 20621 died... 15:53:04.298789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20621): Terminated: ok {rc=0} 15:53:04.343864 --- ParallelTerminationStrategy: PID 20622 died... 15:53:04.362581 run iperf3-srv_10.42.42.10(pid=20622): Terminated {rc=256} 15:53:04.407063 --- ParallelTerminationStrategy: PID 20625 died... 15:53:04.425604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20625): Terminated: ok {rc=0} 15:53:04.470211 --- ParallelTerminationStrategy: PID 20628 died... 15:53:04.488685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20628): Terminated: ok {rc=0} 15:53:04.533814 --- ParallelTerminationStrategy: PID 20631 died... 15:53:04.552494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20631): Terminated: ok {rc=0} 15:53:04.637478 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 15:53:05.787465 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:05.799641 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:53:05.859214 tst iperf3m4.py: using LAC 29014 15:53:05.983865 tst iperf3m4.py: using RAC 199 15:53:06.109376 tst iperf3m4.py: using CellId 29014 15:53:06.235965 tst iperf3m4.py: using BVCI 29015 15:53:06.352034 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:06.363450 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:06.374607 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:06.386287 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:06.397890 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:06.409431 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:06.421293 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:06.432745 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:06.444543 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:53:06.564291 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:53:06.682098 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:53:06.799877 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:53:06.916307 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:53:07.118197 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:07.419502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20633): Launched 15:53:07.680881 run iperf3-srv_10.42.42.10(pid=20634): Launched 15:53:07.793189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:53:07.992749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:08.293246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20635): Launched 15:53:08.553665 run iperf3-srv_10.42.42.10(pid=20636): Launched 15:53:08.666347 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:53:08.866916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:09.167750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20637): Launched 15:53:09.427597 run iperf3-srv_10.42.42.10(pid=20638): Launched 15:53:09.539473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:53:09.738954 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:10.038669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20639): Launched 15:53:10.298918 run iperf3-srv_10.42.42.10(pid=20640): Launched 15:53:10.410788 tst iperf3m4.py:8: start network... 15:53:10.610747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:11.072794 run create_hlr_db(pid=20641): Launched 15:53:11.187768 bus /gobi_6: Setting Powered False 15:53:12.248468 run create_hlr_db(pid=20641): Terminated: ok {rc=0} 15:53:12.666395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20643): Launched 15:53:12.965274 run osmo-hlr_10.42.42.2(pid=20644): Launched 15:53:13.079125 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:13.596846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20646): Launched 15:53:13.896635 run osmo-stp_10.42.42.5(pid=20647): Launched 15:53:14.010336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:14.527203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20649): Launched 15:53:14.642406 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:14.895969 run patchelf(pid=20650): Launched 15:53:15.062301 run osmo-stp_10.42.42.5(pid=20647): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20647)] 15:53:15.189589 run osmo-stp_10.42.42.5(pid=20647): stdout: | (launched: 2022-12-10_15:53:13.841328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:15.318391 run osmo-stp_10.42.42.5(pid=20647): stderr: | [0;m[38;5;43m20221210155314009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155314009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155314009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155314009 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155314010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155314010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155314010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:15.447204 run osmo-stp_10.42.42.5(pid=20647): stdout: | (launched: 2022-12-10_15:53:13.841328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:15.569756 run osmo-stp_10.42.42.5(pid=20647): stderr: | [0;m[38;5;43m20221210155314009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155314009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155314009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155314009 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155314010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155314010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155314010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:15.715175 run patchelf(pid=20650): Terminating (SIGINT) 15:53:15.884620 run patchelf(pid=20650): Terminated: ok {rc=0} 15:53:16.009069 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20647): Process ended prematurely: osmo-stp_10.42.42.5(pid=20647) [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20647)] [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 15:53:16.019373 tst iperf3m4.py:8: Test FAILED (10.3 sec) 15:53:16.050073 run osmo-hlr_10.42.42.2(pid=20644): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20644)] 15:53:16.100865 run osmo-hlr_10.42.42.2(pid=20644): stdout: | (launched: 2022-12-10_15:53:12.910345) 15:53:16.153345 run osmo-hlr_10.42.42.2(pid=20644): stderr: | [0;m[1;31m20221210155313085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155313085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155313085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155313085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155313085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155313085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155313097 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155313106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155313106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155313106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:16.206175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20633): Terminating (SIGTERM) 15:53:16.249633 run iperf3-srv_10.42.42.10(pid=20634): Terminating (SIGTERM) 15:53:16.293689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20635): Terminating (SIGTERM) 15:53:16.336435 run iperf3-srv_10.42.42.10(pid=20636): Terminating (SIGTERM) 15:53:16.378827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20637): Terminating (SIGTERM) 15:53:16.422277 run iperf3-srv_10.42.42.10(pid=20638): Terminating (SIGTERM) 15:53:16.467634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20639): Terminating (SIGTERM) 15:53:16.510616 run iperf3-srv_10.42.42.10(pid=20640): Terminating (SIGTERM) 15:53:16.553139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20643): Terminating (SIGTERM) 15:53:16.595670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20646): Terminating (SIGTERM) 15:53:16.645790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20649): Terminating (SIGTERM) 15:53:16.697438 --- ParallelTerminationStrategy: PID 20633 died... 15:53:16.720584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20633): Terminated: ok {rc=0} 15:53:16.779576 --- ParallelTerminationStrategy: PID 20634 died... 15:53:16.799275 run iperf3-srv_10.42.42.10(pid=20634): Terminated {rc=256} 15:53:16.850542 --- ParallelTerminationStrategy: PID 20635 died... 15:53:16.875023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20635): Terminated: ok {rc=0} 15:53:16.928337 --- ParallelTerminationStrategy: PID 20636 died... 15:53:16.957693 run iperf3-srv_10.42.42.10(pid=20636): Terminated {rc=256} 15:53:17.009844 --- ParallelTerminationStrategy: PID 20637 died... 15:53:17.037796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20637): Terminated: ok {rc=0} 15:53:17.099591 --- ParallelTerminationStrategy: PID 20638 died... 15:53:17.123771 run iperf3-srv_10.42.42.10(pid=20638): Terminated {rc=256} 15:53:17.176139 --- ParallelTerminationStrategy: PID 20639 died... 15:53:17.195935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20639): Terminated: ok {rc=0} 15:53:17.243815 --- ParallelTerminationStrategy: PID 20640 died... 15:53:17.263639 run iperf3-srv_10.42.42.10(pid=20640): Terminated {rc=256} 15:53:17.311184 --- ParallelTerminationStrategy: PID 20643 died... 15:53:17.330899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20643): Terminated: ok {rc=0} 15:53:17.379053 --- ParallelTerminationStrategy: PID 20646 died... 15:53:17.398971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20646): Terminated: ok {rc=0} 15:53:17.452922 --- ParallelTerminationStrategy: PID 20649 died... 15:53:17.472940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20649): Terminated: ok {rc=0} 15:53:17.577476 bus /gobi_4: Setting Powered False 15:53:18.711886 bus /gobi_4: Setting Powered False 15:53:19.832724 bus /gobi_1: Setting Powered False 15:53:20.935782 bus /gobi_1: Setting Powered False 15:53:22.055289 bus /gobi_0: Setting Powered False 15:53:23.160777 bus /gobi_0: Setting Powered False 15:53:24.282126 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 15:53:25.390479 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:25.403996 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:53:25.467590 tst ping.py: using LAC 29015 15:53:25.594625 tst ping.py: using RAC 200 15:53:25.717750 tst ping.py: using CellId 29015 15:53:25.845562 tst ping.py: using BVCI 29016 15:53:25.966131 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:25.978575 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:25.991116 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:26.003205 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:26.015932 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:26.028725 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:26.041725 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:26.054328 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:53:26.176536 tst ping.py:19: start network... 15:53:26.394391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:26.897247 run create_hlr_db(pid=20923): Launched 15:53:27.061690 bus /gobi_6: Setting Powered False 15:53:28.127351 run create_hlr_db(pid=20923): Terminated: ok {rc=0} 15:53:28.582049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20925): Launched 15:53:28.918189 run osmo-hlr_10.42.42.2(pid=20926): Launched 15:53:29.160727 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:29.826088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20928): Launched 15:53:30.164432 run osmo-stp_10.42.42.5(pid=20929): Launched 15:53:30.409992 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:31.098783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20931): Launched 15:53:31.255351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:31.612037 run patchelf(pid=20932): Launched 15:53:31.836899 run osmo-stp_10.42.42.5(pid=20929): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20929)] 15:53:32.014572 run osmo-stp_10.42.42.5(pid=20929): stdout: | (launched: 2022-12-10_15:53:30.101085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:32.176821 run osmo-stp_10.42.42.5(pid=20929): stderr: | [0;m[38;5;43m20221210155330398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155330398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155330398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155330405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155330405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155330405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155330405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:32.339593 run osmo-stp_10.42.42.5(pid=20929): stdout: | (launched: 2022-12-10_15:53:30.101085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:32.499723 run osmo-stp_10.42.42.5(pid=20929): stderr: | [0;m[38;5;43m20221210155330398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155330398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155330398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155330405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155330405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155330405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155330405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:32.686008 run patchelf(pid=20932): Terminating (SIGINT) 15:53:32.906735 run patchelf(pid=20932): Terminated: ok {rc=0} 15:53:33.060185 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20929): Process ended prematurely: osmo-stp_10.42.42.5(pid=20929) [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20929)] [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 15:53:33.074092 tst ping.py:22: Test FAILED (7.7 sec) 15:53:33.108351 run osmo-hlr_10.42.42.2(pid=20926): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20926)] 15:53:33.170358 run osmo-hlr_10.42.42.2(pid=20926): stdout: | (launched: 2022-12-10_15:53:28.856908) 15:53:33.234710 run osmo-hlr_10.42.42.2(pid=20926): stderr: | [0;m[1;31m20221210155329164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155329164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155329164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155329164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155329164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155329164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155329184 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155329192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155329192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155329192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:33.293064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20925): Terminating (SIGTERM) 15:53:33.346571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20928): Terminating (SIGTERM) 15:53:33.399074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20931): Terminating (SIGTERM) 15:53:33.451452 --- ParallelTerminationStrategy: PID 20925 died... 15:53:33.472228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20925): Terminated: ok {rc=0} 15:53:33.520703 --- ParallelTerminationStrategy: PID 20928 died... 15:53:33.543090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20928): Terminated: ok {rc=0} 15:53:33.592626 --- ParallelTerminationStrategy: PID 20931 died... 15:53:33.613559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20931): Terminated: ok {rc=0} 15:53:33.707966 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 15:53:34.801952 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:34.814969 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:53:34.875945 tst ping_idle_ping.py: using LAC 29016 15:53:35.004317 tst ping_idle_ping.py: using RAC 201 15:53:35.135231 tst ping_idle_ping.py: using CellId 29016 15:53:35.261483 tst ping_idle_ping.py: using BVCI 29017 15:53:35.380271 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:35.392696 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:35.404822 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:35.416597 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:35.429079 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:35.440801 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:35.452929 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:35.465335 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:53:35.588621 tst ping_idle_ping.py:24: start network... 15:53:35.806406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:36.313173 run create_hlr_db(pid=20933): Launched 15:53:36.477660 bus /gobi_6: Setting Powered False 15:53:37.543339 run create_hlr_db(pid=20933): Terminated: ok {rc=0} 15:53:38.000162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20935): Launched 15:53:38.335448 run osmo-hlr_10.42.42.2(pid=20936): Launched 15:53:38.577929 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:39.241339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20938): Launched 15:53:39.578490 run osmo-stp_10.42.42.5(pid=20939): Launched 15:53:39.820699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:40.437163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20942): Launched 15:53:40.556030 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:40.820647 run patchelf(pid=20943): Launched 15:53:40.995193 run osmo-stp_10.42.42.5(pid=20939): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20939)] 15:53:41.128372 run osmo-stp_10.42.42.5(pid=20939): stdout: | (launched: 2022-12-10_15:53:39.513872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:41.262672 run osmo-stp_10.42.42.5(pid=20939): stderr: | [0;m[38;5;43m20221210155339812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155339812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155339813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155339813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155339814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155339814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155339814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:41.396886 run osmo-stp_10.42.42.5(pid=20939): stdout: | (launched: 2022-12-10_15:53:39.513872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:41.524863 run osmo-stp_10.42.42.5(pid=20939): stderr: | [0;m[38;5;43m20221210155339812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155339812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155339813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155339813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155339814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155339814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155339814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:41.676727 run patchelf(pid=20943): Terminating (SIGINT) 15:53:41.852323 run patchelf(pid=20943): Terminated: ok {rc=0} 15:53:41.979553 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20939): Process ended prematurely: osmo-stp_10.42.42.5(pid=20939) [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20939)] [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 15:53:41.988800 tst ping_idle_ping.py:27: Test FAILED (7.2 sec) 15:53:42.016626 run osmo-hlr_10.42.42.2(pid=20936): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20936)] 15:53:42.066575 run osmo-hlr_10.42.42.2(pid=20936): stdout: | (launched: 2022-12-10_15:53:38.272228) 15:53:42.118476 run osmo-hlr_10.42.42.2(pid=20936): stderr: | [0;m[1;31m20221210155338583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155338583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155338583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155338583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155338583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155338583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155338602 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155338610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155338611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155338611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:42.170828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20935): Terminating (SIGTERM) 15:53:42.212386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20938): Terminating (SIGTERM) 15:53:42.254322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20942): Terminating (SIGTERM) 15:53:42.296473 --- ParallelTerminationStrategy: PID 20935 died... 15:53:42.316598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20935): Terminated: ok {rc=0} 15:53:42.363523 --- ParallelTerminationStrategy: PID 20938 died... 15:53:42.384029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20938): Terminated: ok {rc=0} 15:53:42.430218 --- ParallelTerminationStrategy: PID 20942 died... 15:53:42.449912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20942): Terminated: ok {rc=0} 15:53:42.536854 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:53:43.829194 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:53:43.835442 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:53:43.857160 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 15:53:43.896894 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 15:53:43.981145 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:53:44.001430 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 15:53:44.040395 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 15:53:44.634495 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 15:53:44.684034 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:44.694926 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:53:44.750902 tst cs_paging_gprs_active.py: using LAC 29017 15:53:44.869151 tst cs_paging_gprs_active.py: using RAC 202 15:53:44.987135 tst cs_paging_gprs_active.py: using CellId 29017 15:53:45.104503 tst cs_paging_gprs_active.py: using BVCI 29018 15:53:45.212685 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.223609 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.234149 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.244905 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.255815 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.266871 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.278001 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.288775 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.299930 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:53:45.417199 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:53:45.532727 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:53:45.734956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:46.068407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20947): Launched 15:53:46.356126 run iperf3-srv_10.42.42.10(pid=20948): Launched 15:53:46.479401 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:53:46.686791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:47.001212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20949): Launched 15:53:47.305687 run iperf3-srv_10.42.42.10(pid=20950): Launched 15:53:47.430011 tst cs_paging_gprs_active.py:38: start network... 15:53:47.647330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:48.142396 run create_hlr_db(pid=20951): Launched 15:53:48.272046 bus /gobi_6: Setting Powered False 15:53:49.334921 run create_hlr_db(pid=20951): Terminated: ok {rc=0} 15:53:49.781013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20953): Launched 15:53:50.101903 run osmo-hlr_10.42.42.2(pid=20954): Launched 15:53:50.223202 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:50.776388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20956): Launched 15:53:51.096821 run osmo-stp_10.42.42.5(pid=20957): Launched 15:53:51.218779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:51.770681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20959): Launched 15:53:51.892224 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:52.162103 run patchelf(pid=20960): Launched 15:53:52.339176 run osmo-stp_10.42.42.5(pid=20957): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20957)] 15:53:52.474502 run osmo-stp_10.42.42.5(pid=20957): stdout: | (launched: 2022-12-10_15:53:51.038271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:52.611815 run osmo-stp_10.42.42.5(pid=20957): stderr: | [0;m[38;5;43m20221210155351228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155351228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155351229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155351229 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155351230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155351230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155351230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:52.749254 run osmo-stp_10.42.42.5(pid=20957): stdout: | (launched: 2022-12-10_15:53:51.038271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:52.879917 run osmo-stp_10.42.42.5(pid=20957): stderr: | [0;m[38;5;43m20221210155351228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155351228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155351229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155351229 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155351230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155351230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155351230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:53.035739 run patchelf(pid=20960): Terminating (SIGINT) 15:53:53.215721 run patchelf(pid=20960): Terminated: ok {rc=0} 15:53:53.345212 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20957): Process ended prematurely: osmo-stp_10.42.42.5(pid=20957) [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20957)] [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 15:53:53.355254 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 15:53:53.383454 run osmo-hlr_10.42.42.2(pid=20954): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20954)] 15:53:53.433300 run osmo-hlr_10.42.42.2(pid=20954): stdout: | (launched: 2022-12-10_15:53:50.042551) 15:53:53.484911 run osmo-hlr_10.42.42.2(pid=20954): stderr: | [0;m[1;31m20221210155350241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155350241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155350241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155350241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155350241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155350241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155350254 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155350262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155350262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155350262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:53.536682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20947): Terminating (SIGTERM) 15:53:53.578450 run iperf3-srv_10.42.42.10(pid=20948): Terminating (SIGTERM) 15:53:53.619797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20949): Terminating (SIGTERM) 15:53:53.661393 run iperf3-srv_10.42.42.10(pid=20950): Terminating (SIGTERM) 15:53:53.702765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20953): Terminating (SIGTERM) 15:53:53.744439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20956): Terminating (SIGTERM) 15:53:53.786146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20959): Terminating (SIGTERM) 15:53:53.827940 --- ParallelTerminationStrategy: PID 20947 died... 15:53:53.847771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20947): Terminated: ok {rc=0} 15:53:53.893737 --- ParallelTerminationStrategy: PID 20948 died... 15:53:53.912900 run iperf3-srv_10.42.42.10(pid=20948): Terminated {rc=256} 15:53:53.958524 --- ParallelTerminationStrategy: PID 20949 died... 15:53:53.977833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20949): Terminated: ok {rc=0} 15:53:54.023419 --- ParallelTerminationStrategy: PID 20950 died... 15:53:54.042552 run iperf3-srv_10.42.42.10(pid=20950): Terminated {rc=256} 15:53:54.088443 --- ParallelTerminationStrategy: PID 20953 died... 15:53:54.108016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20953): Terminated: ok {rc=0} 15:53:54.154140 --- ParallelTerminationStrategy: PID 20956 died... 15:53:54.173438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20956): Terminated: ok {rc=0} 15:53:54.218946 --- ParallelTerminationStrategy: PID 20959 died... 15:53:54.238355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20959): Terminated: ok {rc=0} 15:53:54.324496 bus /gobi_0: Setting Powered False 15:53:55.423821 bus /gobi_0: Setting Powered False 15:53:56.538293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 15:53:57.685671 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:57.697667 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:53:57.758215 tst iperf3.py: using LAC 29018 15:53:57.882384 tst iperf3.py: using RAC 203 15:53:58.006666 tst iperf3.py: using CellId 29018 15:53:58.132545 tst iperf3.py: using BVCI 29019 15:53:58.241232 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:58.252292 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:58.263072 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:58.274031 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:58.284844 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:58.295898 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:58.307001 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:58.317798 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:58.328713 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:53:58.446754 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:53:58.647003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:58.945935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20962): Launched 15:53:59.205711 run iperf3-srv_10.42.42.10(pid=20963): Launched 15:53:59.317880 tst iperf3.py:8: start network... 15:53:59.518417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:59.981655 run create_hlr_db(pid=20964): Launched 15:54:00.095691 bus /gobi_6: Setting Powered False 15:54:01.183967 run create_hlr_db(pid=20964): Terminated: ok {rc=0} 15:54:01.658543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20966): Launched 15:54:01.975782 run osmo-hlr_10.42.42.2(pid=20967): Launched 15:54:02.189099 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:02.761825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20969): Launched 15:54:03.061068 run osmo-stp_10.42.42.5(pid=20970): Launched 15:54:03.175115 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:03.690344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20972): Launched 15:54:03.805130 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:04.057737 run patchelf(pid=20973): Launched 15:54:04.224040 run osmo-stp_10.42.42.5(pid=20970): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20970)] 15:54:04.351125 run osmo-stp_10.42.42.5(pid=20970): stdout: | (launched: 2022-12-10_15:54:03.006251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:04.480209 run osmo-stp_10.42.42.5(pid=20970): stderr: | [0;m[38;5;43m20221210155403178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155403178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155403179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155403179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155403179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155403179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155403180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:04.609683 run osmo-stp_10.42.42.5(pid=20970): stdout: | (launched: 2022-12-10_15:54:03.006251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:04.732485 run osmo-stp_10.42.42.5(pid=20970): stderr: | [0;m[38;5;43m20221210155403178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155403178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155403179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155403179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155403179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155403179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155403180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:04.878186 run patchelf(pid=20973): Terminating (SIGINT) 15:54:05.046554 run patchelf(pid=20973): Terminated: ok {rc=0} 15:54:05.168716 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20970): Process ended prematurely: osmo-stp_10.42.42.5(pid=20970) [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20970)] [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 15:54:05.178212 tst iperf3.py:8: Test FAILED (7.5 sec) 15:54:05.206049 run osmo-hlr_10.42.42.2(pid=20967): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20967)] 15:54:05.253779 run osmo-hlr_10.42.42.2(pid=20967): stdout: | (launched: 2022-12-10_15:54:01.917764) 15:54:05.303635 run osmo-hlr_10.42.42.2(pid=20967): stderr: | [0;m[1;31m20221210155402266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155402266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155402266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155402266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155402266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155402266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155402286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155402298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155402299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155402299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:05.353511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20962): Terminating (SIGTERM) 15:54:05.393222 run iperf3-srv_10.42.42.10(pid=20963): Terminating (SIGTERM) 15:54:05.433212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20966): Terminating (SIGTERM) 15:54:05.474193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20969): Terminating (SIGTERM) 15:54:05.514051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20972): Terminating (SIGTERM) 15:54:05.554556 --- ParallelTerminationStrategy: PID 20962 died... 15:54:05.573332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20962): Terminated: ok {rc=0} 15:54:05.618226 --- ParallelTerminationStrategy: PID 20963 died... 15:54:05.636806 run iperf3-srv_10.42.42.10(pid=20963): Terminated {rc=256} 15:54:05.680879 --- ParallelTerminationStrategy: PID 20966 died... 15:54:05.699752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20966): Terminated: ok {rc=0} 15:54:05.743792 --- ParallelTerminationStrategy: PID 20969 died... 15:54:05.762284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20969): Terminated: ok {rc=0} 15:54:05.806851 --- ParallelTerminationStrategy: PID 20972 died... 15:54:05.825496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20972): Terminated: ok {rc=0} 15:54:05.911928 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 15:54:07.059715 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:07.071241 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:54:07.129204 tst iperf3m4.py: using LAC 29019 15:54:07.248047 tst iperf3m4.py: using RAC 204 15:54:07.374325 tst iperf3m4.py: using CellId 29019 15:54:07.499182 tst iperf3m4.py: using BVCI 29020 15:54:07.615154 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:07.626742 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:07.638011 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:07.649081 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:07.660064 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:07.671221 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:07.682465 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:07.693491 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:07.704625 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:54:07.820259 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:54:07.940400 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:54:08.057123 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:54:08.170773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:54:08.371572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:54:08.672210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20974): Launched 15:54:08.931960 run iperf3-srv_10.42.42.10(pid=20975): Launched 15:54:09.043640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:54:09.243922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:54:09.543583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20976): Launched 15:54:09.803155 run iperf3-srv_10.42.42.10(pid=20977): Launched 15:54:09.914787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:54:10.114657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:54:10.414486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20978): Launched 15:54:10.674167 run iperf3-srv_10.42.42.10(pid=20979): Launched 15:54:10.785620 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:54:10.986122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:54:11.286884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20980): Launched 15:54:11.546472 run iperf3-srv_10.42.42.10(pid=20981): Launched 15:54:11.658118 tst iperf3m4.py:8: start network... 15:54:11.858036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:12.320200 run create_hlr_db(pid=20982): Launched 15:54:12.434997 bus /gobi_6: Setting Powered False 15:54:13.494933 run create_hlr_db(pid=20982): Terminated: ok {rc=0} 15:54:13.932125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20984): Launched 15:54:14.253073 run osmo-hlr_10.42.42.2(pid=20985): Launched 15:54:14.374906 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:14.927878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20987): Launched 15:54:15.247832 run osmo-stp_10.42.42.5(pid=20988): Launched 15:54:15.369427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:15.941454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20990): Launched 15:54:16.067045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:16.333917 run patchelf(pid=20991): Launched 15:54:16.511033 run osmo-stp_10.42.42.5(pid=20988): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20988)] 15:54:16.648240 run osmo-stp_10.42.42.5(pid=20988): stdout: | (launched: 2022-12-10_15:54:15.189072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:16.786566 run osmo-stp_10.42.42.5(pid=20988): stderr: | [0;m[38;5;43m20221210155415380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155415381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155415381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155415381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155415382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155415382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155415382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:16.925516 run osmo-stp_10.42.42.5(pid=20988): stdout: | (launched: 2022-12-10_15:54:15.189072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:17.058148 run osmo-stp_10.42.42.5(pid=20988): stderr: | [0;m[38;5;43m20221210155415380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155415381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155415381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155415381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155415382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155415382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155415382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:17.215872 run patchelf(pid=20991): Terminating (SIGINT) 15:54:17.394709 run patchelf(pid=20991): Terminated: ok {rc=0} 15:54:17.523636 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20988): Process ended prematurely: osmo-stp_10.42.42.5(pid=20988) [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20988)] [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 15:54:17.533731 tst iperf3m4.py:8: Test FAILED (10.5 sec) 15:54:17.562353 run osmo-hlr_10.42.42.2(pid=20985): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20985)] 15:54:17.612509 run osmo-hlr_10.42.42.2(pid=20985): stdout: | (launched: 2022-12-10_15:54:14.194815) 15:54:17.664381 run osmo-hlr_10.42.42.2(pid=20985): stderr: | [0;m[1;31m20221210155414393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155414393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155414393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155414393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155414393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155414393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155414405 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155414413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155414413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155414413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:17.716735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20974): Terminating (SIGTERM) 15:54:17.758613 run iperf3-srv_10.42.42.10(pid=20975): Terminating (SIGTERM) 15:54:17.800486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20976): Terminating (SIGTERM) 15:54:17.842356 run iperf3-srv_10.42.42.10(pid=20977): Terminating (SIGTERM) 15:54:17.884174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20978): Terminating (SIGTERM) 15:54:17.926264 run iperf3-srv_10.42.42.10(pid=20979): Terminating (SIGTERM) 15:54:17.968013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20980): Terminating (SIGTERM) 15:54:18.010036 run iperf3-srv_10.42.42.10(pid=20981): Terminating (SIGTERM) 15:54:18.051784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20984): Terminating (SIGTERM) 15:54:18.094100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20987): Terminating (SIGTERM) 15:54:18.135847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20990): Terminating (SIGTERM) 15:54:18.178004 --- ParallelTerminationStrategy: PID 20974 died... 15:54:18.198017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20974): Terminated: ok {rc=0} 15:54:18.244276 --- ParallelTerminationStrategy: PID 20975 died... 15:54:18.263787 run iperf3-srv_10.42.42.10(pid=20975): Terminated {rc=256} 15:54:18.309878 --- ParallelTerminationStrategy: PID 20976 died... 15:54:18.329377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20976): Terminated: ok {rc=0} 15:54:18.375520 --- ParallelTerminationStrategy: PID 20977 died... 15:54:18.394884 run iperf3-srv_10.42.42.10(pid=20977): Terminated {rc=256} 15:54:18.440877 --- ParallelTerminationStrategy: PID 20978 died... 15:54:18.460712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20978): Terminated: ok {rc=0} 15:54:18.506894 --- ParallelTerminationStrategy: PID 20979 died... 15:54:18.526420 run iperf3-srv_10.42.42.10(pid=20979): Terminated {rc=256} 15:54:18.572892 --- ParallelTerminationStrategy: PID 20980 died... 15:54:18.592749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20980): Terminated: ok {rc=0} 15:54:18.638886 --- ParallelTerminationStrategy: PID 20981 died... 15:54:18.658426 run iperf3-srv_10.42.42.10(pid=20981): Terminated {rc=256} 15:54:18.704348 --- ParallelTerminationStrategy: PID 20984 died... 15:54:18.723964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20984): Terminated: ok {rc=0} 15:54:18.770089 --- ParallelTerminationStrategy: PID 20987 died... 15:54:18.789598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20987): Terminated: ok {rc=0} 15:54:18.835618 --- ParallelTerminationStrategy: PID 20990 died... 15:54:18.855158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20990): Terminated: ok {rc=0} 15:54:18.942703 bus /gobi_4: Setting Powered False 15:54:20.041890 bus /gobi_4: Setting Powered False 15:54:21.159883 bus /gobi_1: Setting Powered False 15:54:22.257672 bus /gobi_1: Setting Powered False 15:54:23.373457 bus /gobi_0: Setting Powered False 15:54:24.472526 bus /gobi_0: Setting Powered False 15:54:25.588676 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 15:54:26.690819 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:26.702924 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:54:26.766810 tst ping.py: using LAC 29020 15:54:26.881363 tst ping.py: using RAC 205 15:54:26.995619 tst ping.py: using CellId 29020 15:54:27.118280 tst ping.py: using BVCI 29021 15:54:27.231973 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:27.243413 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:27.254809 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:27.266203 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:27.277815 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:27.289242 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:27.300633 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:27.311882 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:54:27.427643 tst ping.py:19: start network... 15:54:27.638851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:28.123070 run create_hlr_db(pid=20992): Launched 15:54:28.249442 bus /gobi_6: Setting Powered False 15:54:29.312434 run create_hlr_db(pid=20992): Terminated: ok {rc=0} 15:54:29.735741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20994): Launched 15:54:30.030297 run osmo-hlr_10.42.42.2(pid=20995): Launched 15:54:30.141967 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:30.651744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20997): Launched 15:54:30.981877 run osmo-stp_10.42.42.5(pid=20998): Launched 15:54:31.306680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:31.853724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21000): Launched 15:54:31.986493 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:32.259751 run patchelf(pid=21001): Launched 15:54:32.434594 run osmo-stp_10.42.42.5(pid=20998): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20998)] 15:54:32.567781 run osmo-stp_10.42.42.5(pid=20998): stdout: | (launched: 2022-12-10_15:54:30.924161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:32.702925 run osmo-stp_10.42.42.5(pid=20998): stderr: | [0;m[38;5;43m20221210155431236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155431237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155431238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155431238 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:32.837931 run osmo-stp_10.42.42.5(pid=20998): stdout: | (launched: 2022-12-10_15:54:30.924161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:32.967155 run osmo-stp_10.42.42.5(pid=20998): stderr: | [0;m[38;5;43m20221210155431236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155431237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155431238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155431238 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:33.119616 run patchelf(pid=21001): Terminating (SIGINT) 15:54:33.294474 run patchelf(pid=21001): Terminated: ok {rc=0} 15:54:33.421344 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20998): Process ended prematurely: osmo-stp_10.42.42.5(pid=20998) [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20998)] [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 15:54:33.430789 tst ping.py:22: Test FAILED (6.7 sec) 15:54:33.458699 run osmo-hlr_10.42.42.2(pid=20995): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20995)] 15:54:33.508719 run osmo-hlr_10.42.42.2(pid=20995): stdout: | (launched: 2022-12-10_15:54:29.976039) 15:54:33.560390 run osmo-hlr_10.42.42.2(pid=20995): stderr: | [0;m[1;31m20221210155430151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155430151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155430151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155430151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155430151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155430152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155430165 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155430174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155430175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155430175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:33.612419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20994): Terminating (SIGTERM) 15:54:33.654324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20997): Terminating (SIGTERM) 15:54:33.696534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21000): Terminating (SIGTERM) 15:54:33.738755 --- ParallelTerminationStrategy: PID 20994 died... 15:54:33.758899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20994): Terminated: ok {rc=0} 15:54:33.805625 --- ParallelTerminationStrategy: PID 20997 died... 15:54:33.825340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20997): Terminated: ok {rc=0} 15:54:33.871595 --- ParallelTerminationStrategy: PID 21000 died... 15:54:33.891252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21000): Terminated: ok {rc=0} 15:54:33.979191 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 15:54:35.067577 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:35.080076 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:54:35.139703 tst ping_idle_ping.py: using LAC 29021 15:54:35.257802 tst ping_idle_ping.py: using RAC 206 15:54:35.373736 tst ping_idle_ping.py: using CellId 29021 15:54:35.491270 tst ping_idle_ping.py: using BVCI 29022 15:54:35.599811 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:35.610740 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:35.621434 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:35.632265 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:35.643314 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:35.654199 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:35.665280 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:35.676115 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:54:35.794613 tst ping_idle_ping.py:24: start network... 15:54:36.007022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:36.500533 run create_hlr_db(pid=21002): Launched 15:54:36.627613 bus /gobi_6: Setting Powered False 15:54:37.690806 run create_hlr_db(pid=21002): Terminated: ok {rc=0} 15:54:38.129023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21004): Launched 15:54:38.442485 run osmo-hlr_10.42.42.2(pid=21005): Launched 15:54:38.561688 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:39.101291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21007): Launched 15:54:39.415717 run osmo-stp_10.42.42.5(pid=21008): Launched 15:54:39.535507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:40.077333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21010): Launched 15:54:40.197275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:40.462772 run patchelf(pid=21011): Launched 15:54:40.636577 run osmo-stp_10.42.42.5(pid=21008): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21008)] 15:54:40.769878 run osmo-stp_10.42.42.5(pid=21008): stdout: | (launched: 2022-12-10_15:54:39.358012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:40.904267 run osmo-stp_10.42.42.5(pid=21008): stderr: | [0;m[38;5;43m20221210155439549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155439549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155439550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155439550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155439550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155439551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155439551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:41.039048 run osmo-stp_10.42.42.5(pid=21008): stdout: | (launched: 2022-12-10_15:54:39.358012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:41.168225 run osmo-stp_10.42.42.5(pid=21008): stderr: | [0;m[38;5;43m20221210155439549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155439549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155439550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155439550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155439550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155439551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155439551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:41.320528 run patchelf(pid=21011): Terminating (SIGINT) 15:54:41.496858 run patchelf(pid=21011): Terminated: ok {rc=0} 15:54:41.624283 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21008): Process ended prematurely: osmo-stp_10.42.42.5(pid=21008) [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21008)] [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 15:54:41.633973 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 15:54:41.662047 run osmo-hlr_10.42.42.2(pid=21005): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21005)] 15:54:41.712132 run osmo-hlr_10.42.42.2(pid=21005): stdout: | (launched: 2022-12-10_15:54:38.385244) 15:54:41.763856 run osmo-hlr_10.42.42.2(pid=21005): stderr: | [0;m[1;31m20221210155438582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155438583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155438583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155438583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155438583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155438583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155438598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155438609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155438609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155438609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:41.816098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21004): Terminating (SIGTERM) 15:54:41.858154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21007): Terminating (SIGTERM) 15:54:41.900349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21010): Terminating (SIGTERM) 15:54:41.942666 --- ParallelTerminationStrategy: PID 21004 died... 15:54:41.962742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21004): Terminated: ok {rc=0} 15:54:42.009126 --- ParallelTerminationStrategy: PID 21007 died... 15:54:42.028543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21007): Terminated: ok {rc=0} 15:54:42.074617 --- ParallelTerminationStrategy: PID 21010 died... 15:54:42.094325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21010): Terminated: ok {rc=0} 15:54:42.181762 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:54:43.476920 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:54:43.484443 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:54:43.505848 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 15:54:43.540999 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:54:43.596301 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:54:43.617514 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 15:54:43.652314 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:54:44.209921 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 15:54:44.215115 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:44.226769 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:54:44.284172 tst switch_tch_pdch.py: using LAC 29022 15:54:44.408037 tst switch_tch_pdch.py: using RAC 207 15:54:44.529878 tst switch_tch_pdch.py: using CellId 29022 15:54:44.652812 tst switch_tch_pdch.py: using BVCI 29023 15:54:44.767410 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:44.779050 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:44.790419 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:44.801790 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:44.813070 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:44.824541 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:44.836111 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:44.847490 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:54:44.960062 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:54:45.079869 tst switch_tch_pdch.py:51: start network... 15:54:45.290644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:45.774727 run create_hlr_db(pid=21016): Launched 15:54:45.909569 bus /gobi_6: Setting Powered False 15:54:46.970544 run create_hlr_db(pid=21016): Terminated: ok {rc=0} 15:54:47.413595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21018): Launched 15:54:47.727147 run osmo-hlr_10.42.42.2(pid=21019): Launched 15:54:47.845224 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:48.390403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21021): Launched 15:54:48.702903 run osmo-stp_10.42.42.5(pid=21022): Launched 15:54:48.821295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:49.361536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21024): Launched 15:54:49.481419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:49.745935 run patchelf(pid=21025): Launched 15:54:49.919012 run osmo-stp_10.42.42.5(pid=21022): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21022)] 15:54:50.051720 run osmo-stp_10.42.42.5(pid=21022): stdout: | (launched: 2022-12-10_15:54:48.645380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:50.186482 run osmo-stp_10.42.42.5(pid=21022): stderr: | [0;m[38;5;43m20221210155448837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155448837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155448837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155448838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155448838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155448838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155448838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:50.320447 run osmo-stp_10.42.42.5(pid=21022): stdout: | (launched: 2022-12-10_15:54:48.645380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:50.448655 run osmo-stp_10.42.42.5(pid=21022): stderr: | [0;m[38;5;43m20221210155448837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155448837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155448837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155448838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155448838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155448838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155448838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:50.600806 run patchelf(pid=21025): Terminating (SIGINT) 15:54:50.775773 run patchelf(pid=21025): Terminated: ok {rc=0} 15:54:50.901988 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21022): Process ended prematurely: osmo-stp_10.42.42.5(pid=21022) [trial-2376↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21022)] [trial-2376↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 15:54:50.911297 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 15:54:50.939215 run osmo-hlr_10.42.42.2(pid=21019): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21019)] 15:54:50.988827 run osmo-hlr_10.42.42.2(pid=21019): stdout: | (launched: 2022-12-10_15:54:47.669996) 15:54:51.040120 run osmo-hlr_10.42.42.2(pid=21019): stderr: | [0;m[1;31m20221210155447868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155447868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155447868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155447869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155447869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155447869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155447881 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155447892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155447892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155447892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:51.091933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21018): Terminating (SIGTERM) 15:54:51.133913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21021): Terminating (SIGTERM) 15:54:51.175396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21024): Terminating (SIGTERM) 15:54:51.217009 --- ParallelTerminationStrategy: PID 21018 died... 15:54:51.236856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21018): Terminated: ok {rc=0} 15:54:51.282563 --- ParallelTerminationStrategy: PID 21021 died... 15:54:51.301677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21021): Terminated: ok {rc=0} 15:54:51.347171 --- ParallelTerminationStrategy: PID 21024 died... 15:54:51.366418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21024): Terminated: ok {rc=0} 15:54:51.453610 bus /gobi_0: Setting Powered False 15:54:52.552901 bus /gobi_0: Setting Powered False 15:54:53.668312 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 15:54:54.910370 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:54:54.917325 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 15:54:54.939608 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 15:54:54.976521 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 15:54:55.031667 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 15:54:55.053895 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 15:54:55.089228 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 15:54:55.639160 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 15:54:55.644095 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:55.654867 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 15:54:55.710778 tst switch_tch_pdch.py: using LAC 29023 15:54:55.827320 tst switch_tch_pdch.py: using RAC 208 15:54:55.942246 tst switch_tch_pdch.py: using CellId 29023 15:54:56.057152 tst switch_tch_pdch.py: using BVCI 29024 15:54:56.171782 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:56.183492 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:56.194565 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:56.205773 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:56.216866 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:56.227827 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:56.239192 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:56.250245 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:54:56.365862 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:54:56.483928 tst switch_tch_pdch.py:51: start network... 15:54:56.680795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:57.109565 run create_hlr_db(pid=21030): Launched 15:54:57.222663 bus /gobi_6: Setting Powered False 15:54:58.282219 run create_hlr_db(pid=21030): Terminated: ok {rc=0} 15:54:58.666321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21032): Launched 15:54:58.958079 run osmo-hlr_10.42.42.2(pid=21033): Launched 15:54:59.069676 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:59.564365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21035): Launched 15:54:59.856715 run osmo-stp_10.42.42.5(pid=21036): Launched 15:54:59.968050 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:55:00.448899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21038): Launched 15:55:00.560677 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:55:00.807666 run patchelf(pid=21039): Launched 15:55:01.002433 run osmo-stp_10.42.42.5(pid=21036): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21036)] 15:55:01.139280 run osmo-stp_10.42.42.5(pid=21036): stdout: | (launched: 2022-12-10_15:54:59.802783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:01.277118 run osmo-stp_10.42.42.5(pid=21036): stderr: | [0;m[38;5;43m20221210155459974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155459974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155459974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155459974 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155459975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155459975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155459975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:01.423343 run osmo-stp_10.42.42.5(pid=21036): stdout: | (launched: 2022-12-10_15:54:59.802783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:01.554728 run osmo-stp_10.42.42.5(pid=21036): stderr: | [0;m[38;5;43m20221210155459974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155459974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155459974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155459974 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155459975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155459975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155459975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:01.710627 run patchelf(pid=21039): Terminating (SIGINT) 15:55:01.901035 run patchelf(pid=21039): Terminated: ok {rc=0} 15:55:02.031222 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21036): Process ended prematurely: osmo-stp_10.42.42.5(pid=21036) [trial-2376↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21036)] [trial-2376↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 15:55:02.041400 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 15:55:02.070513 run osmo-hlr_10.42.42.2(pid=21033): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21033)] 15:55:02.122655 run osmo-hlr_10.42.42.2(pid=21033): stdout: | (launched: 2022-12-10_15:54:58.904219) 15:55:02.176773 run osmo-hlr_10.42.42.2(pid=21033): stderr: | [0;m[1;31m20221210155459080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155459080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155459080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155459080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155459080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155459080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155459092 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155459100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155459100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155459100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:02.229073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21032): Terminating (SIGTERM) 15:55:02.271477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21035): Terminating (SIGTERM) 15:55:02.313579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21038): Terminating (SIGTERM) 15:55:02.356096 --- ParallelTerminationStrategy: PID 21032 died... 15:55:02.376000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21032): Terminated: ok {rc=0} 15:55:02.423112 --- ParallelTerminationStrategy: PID 21035 died... 15:55:02.442525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21035): Terminated: ok {rc=0} 15:55:02.489866 --- ParallelTerminationStrategy: PID 21038 died... 15:55:02.509531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21038): Terminated: ok {rc=0} 15:55:02.598473 bus /gobi_0: Setting Powered False 15:55:03.699044 bus /gobi_0: Setting Powered False 15:55:04.814511 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_sms:trx-b200 --------------------------------------------------------------------- 15:55:06.051566 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:06.055598 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 15:55:06.089111 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 15:55:06.096092 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 15:55:06.150402 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 15:55:06.184593 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 15:55:06.191498 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 15:55:06.731053 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 15:55:06.736089 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 15:55:06.747255 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 15:55:06.796565 tst mo_mt_sms.py: using LAC 29024 15:55:06.917440 tst mo_mt_sms.py: using RAC 209 15:55:07.040013 tst mo_mt_sms.py: using CellId 29024 15:55:07.162795 tst mo_mt_sms.py: using BVCI 29025 15:55:07.275903 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 15:55:07.387600 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 15:55:07.502622 tst mo_mt_sms.py:9: start nitb and bts... 15:55:07.712786 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:55:08.344341 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21047): Launched 15:55:08.653267 run osmo-nitb_10.42.42.2(pid=21048): Launched 15:55:08.823386 run osmo-nitb_10.42.42.2(pid=21048): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21048)] 15:55:08.961925 run osmo-nitb_10.42.42.2(pid=21048): stdout: | (launched: 2022-12-10_15:55:08.597250) 15:55:09.102014 run osmo-nitb_10.42.42.2(pid=21048): stderr: | (launched: 2022-12-10_15:55:08.643340) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:55:09.242732 run osmo-nitb_10.42.42.2(pid=21048): stdout: | (launched: 2022-12-10_15:55:08.597250) 15:55:09.377048 run osmo-nitb_10.42.42.2(pid=21048): stderr: | (launched: 2022-12-10_15:55:08.643340) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21048) [trial-2376↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21048)] 15:55:09.769273 tst osmo-nitb_10.42.42.2(pid=21048): stdout: | (launched: 2022-12-10_15:55:08.597250) 15:55:09.894190 tst osmo-nitb_10.42.42.2(pid=21048): stderr: | (launched: 2022-12-10_15:55:08.643340) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:55:10.041714 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21048) [trial-2376↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21048)] [trial-2376↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 15:55:10.050510 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 15:55:10.057459 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21047): Terminating (SIGTERM) 15:55:10.269016 --- ParallelTerminationStrategy: PID 21047 died... 15:55:10.290043 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21047): Terminated: ok {rc=0} 15:55:10.378303 bus /sierra_3: Setting Powered False 15:55:11.477079 bus /sierra_3: Setting Powered False 15:55:12.593191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 sms:trx-b200 --------------------------------------------------------------------- 15:55:13.791956 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:13.795827 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 15:55:13.828892 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:55:13.855219 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 15:55:13.906101 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 15:55:13.939865 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:55:13.966995 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 15:55:14.513728 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 15:55:14.518994 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:14.530170 tst sms:trx-b200: Using 1 x bts (candidates: 1) 15:55:14.582693 tst mo_mt_sms.py: using LAC 29025 15:55:14.696455 tst mo_mt_sms.py: using RAC 210 15:55:14.808640 tst mo_mt_sms.py: using CellId 29025 15:55:14.923518 tst mo_mt_sms.py: using BVCI 29026 15:55:15.028086 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:15.038610 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:15.048828 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:15.059388 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:15.069970 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:15.080301 tst sms:trx-b200: Using 1 x modem (candidates: 2) 15:55:15.196421 tst sms:trx-b200: Using 1 x modem (candidates: 2) 15:55:15.309345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:15.759380 run create_hlr_db(pid=21052): Launched 15:55:15.889332 bus /sierra_2: Setting Powered False 15:55:16.961345 run create_hlr_db(pid=21052): Terminated: ok {rc=0} 15:55:17.436514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21054): Launched 15:55:17.726014 run osmo-hlr_10.42.42.2(pid=21055): Launched 15:55:17.835481 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:18.330210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21057): Launched 15:55:18.617584 run osmo-stp_10.42.42.5(pid=21058): Launched 15:55:18.726983 run osmo-msc_10.42.42.6: Starting osmo-msc 15:55:19.251030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21060): Launched 15:55:19.539864 run osmo-msc_10.42.42.6(pid=21061): Launched 15:55:19.700696 run osmo-stp_10.42.42.5(pid=21058): ERR: Terminated: ERROR {rc=1} [trial-2376↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21058)] 15:55:19.824521 run osmo-stp_10.42.42.5(pid=21058): stdout: | (launched: 2022-12-10_15:55:18.565317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:19.948657 run osmo-stp_10.42.42.5(pid=21058): stderr: | [0;m[38;5;43m20221210155518732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155518732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155518733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155518733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155518733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155518733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155518734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:20.069239 run osmo-stp_10.42.42.5(pid=21058): stdout: | (launched: 2022-12-10_15:55:18.565317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:20.184452 run osmo-stp_10.42.42.5(pid=21058): stderr: | [0;m[38;5;43m20221210155518732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155518732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155518733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155518733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155518733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155518733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155518734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:20.322375 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21058): Process ended prematurely: osmo-stp_10.42.42.5(pid=21058) [trial-2376↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21058)] [trial-2376↪sms:trx-b200↪mo_mt_sms.py:16] 15:55:20.330602 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 15:55:20.356939 run osmo-hlr_10.42.42.2(pid=21055): ERR: Terminated: ERROR {rc=237} [trial-2376↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21055)] 15:55:20.405119 run osmo-hlr_10.42.42.2(pid=21055): stdout: | (launched: 2022-12-10_15:55:17.673131) 15:55:20.454759 run osmo-hlr_10.42.42.2(pid=21055): stderr: | [0;m[1;31m20221210155517849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155517849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155517849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155517849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155517849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155517849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155517861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155517869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155517869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155517870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:20.524131 run osmo-msc_10.42.42.6(pid=21061): ERR: Terminated: ERROR {rc=2} [trial-2376↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21061)] 15:55:20.571968 run osmo-msc_10.42.42.6(pid=21061): stdout: | (launched: 2022-12-10_15:55:19.486974) 15:55:20.621549 run osmo-msc_10.42.42.6(pid=21061): stderr: | [0;m[38;5;43m20221210155519758 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155519758 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe81a492c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155519758 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155519758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155519758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155519758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155519760 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155519761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155519761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155519761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:55:20.671725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21054): Terminating (SIGTERM) 15:55:20.711965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21057): Terminating (SIGTERM) 15:55:20.752278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21060): Terminating (SIGTERM) 15:55:20.792613 --- ParallelTerminationStrategy: PID 21054 died... 15:55:20.811816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21054): Terminated: ok {rc=0} 15:55:20.856192 --- ParallelTerminationStrategy: PID 21057 died... 15:55:20.874663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21057): Terminated: ok {rc=0} 15:55:20.918936 --- ParallelTerminationStrategy: PID 21060 died... 15:55:20.937399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21060): Terminated: ok {rc=0} 15:55:21.021145 bus /sierra_3: Setting Powered False 15:55:22.119208 bus /sierra_3: Setting Powered False 15:55:23.235664 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_ussd:trx-b200 --------------------------------------------------------------------- 15:55:24.458837 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:24.462501 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 15:55:24.495887 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 15:55:24.502802 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 15:55:24.537714 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 15:55:24.570941 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 15:55:24.577592 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 15:55:25.095881 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2376 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 15:55:25.101266 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 15:55:25.111884 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 15:55:25.160797 tst assert_extension.py: using LAC 29026 15:55:25.276884 tst assert_extension.py: using RAC 211 15:55:25.400337 tst assert_extension.py: using CellId 29026 15:55:25.522722 tst assert_extension.py: using BVCI 29027 15:55:25.634645 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 15:55:25.745725 tst assert_extension.py:10: start nitb and bts... 15:55:25.940031 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:55:26.530101 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21066): Launched 15:55:26.817086 run osmo-nitb_10.42.42.2(pid=21067): Launched 15:55:26.976395 run osmo-nitb_10.42.42.2(pid=21067): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21067)] 15:55:27.106223 run osmo-nitb_10.42.42.2(pid=21067): stdout: | (launched: 2022-12-10_15:55:26.764646) 15:55:27.238105 run osmo-nitb_10.42.42.2(pid=21067): stderr: | (launched: 2022-12-10_15:55:26.807263) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:55:27.369884 run osmo-nitb_10.42.42.2(pid=21067): stdout: | (launched: 2022-12-10_15:55:26.764646) 15:55:27.495710 run osmo-nitb_10.42.42.2(pid=21067): stderr: | (launched: 2022-12-10_15:55:26.807263) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21067) [trial-2376↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21067)] 15:55:27.925928 tst osmo-nitb_10.42.42.2(pid=21067): stdout: | (launched: 2022-12-10_15:55:26.764646) 15:55:28.043646 tst osmo-nitb_10.42.42.2(pid=21067): stderr: | (launched: 2022-12-10_15:55:26.807263) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:55:28.181840 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21067) [trial-2376↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21067)] [trial-2376↪nitb_ussd:trx-b200↪assert_extension.py:12] 15:55:28.190315 tst assert_extension.py:12: Test FAILED (3.1 sec) 15:55:28.197028 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21066): Terminating (SIGTERM) 15:55:28.407059 --- ParallelTerminationStrategy: PID 21066 died... 15:55:28.428000 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21066): Terminated: ok {rc=0} 15:55:28.514071 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 ussd:trx-b200 --------------------------------------------------------------------- 15:55:29.698008 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:29.702998 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 15:55:29.736915 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:55:29.764508 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 15:55:29.798878 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 15:55:29.832717 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:55:29.860164 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 15:55:30.389937 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 ussd:trx-b200 assert_extension.py ---------------------------------------------- 15:55:30.395966 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:30.407591 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 15:55:30.454586 tst assert_extension.py: using LAC 29027 15:55:30.567535 tst assert_extension.py: using RAC 212 15:55:30.682111 tst assert_extension.py: using CellId 29027 15:55:30.794696 tst assert_extension.py: using BVCI 29028 15:55:30.915782 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:30.928644 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:30.939913 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:30.951759 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:30.963687 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:30.975432 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 15:55:31.108588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:31.576531 run create_hlr_db(pid=21071): Launched 15:55:31.723579 bus /sierra_2: Setting Powered False 15:55:32.781224 run create_hlr_db(pid=21071): Terminated: ok {rc=0} 15:55:33.210106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21073): Launched 15:55:33.519432 run osmo-hlr_10.42.42.2(pid=21074): Launched 15:55:33.638099 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:34.173390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21076): Launched 15:55:34.482970 run osmo-stp_10.42.42.5(pid=21077): Launched 15:55:34.600586 run osmo-msc_10.42.42.6: Starting osmo-msc 15:55:35.158777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21079): Launched 15:55:35.466536 run osmo-msc_10.42.42.6(pid=21080): Launched 15:55:35.638647 run osmo-stp_10.42.42.5(pid=21077): ERR: Terminated: ERROR {rc=1} [trial-2376↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21077)] 15:55:35.769532 run osmo-stp_10.42.42.5(pid=21077): stdout: | (launched: 2022-12-10_15:55:34.426631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:35.901229 run osmo-stp_10.42.42.5(pid=21077): stderr: | [0;m[38;5;43m20221210155534618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155534618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155534618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155534618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155534619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155534619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155534619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:36.031848 run osmo-stp_10.42.42.5(pid=21077): stdout: | (launched: 2022-12-10_15:55:34.426631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:36.156408 run osmo-stp_10.42.42.5(pid=21077): stderr: | [0;m[38;5;43m20221210155534618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155534618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155534618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155534618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155534619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155534619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155534619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:36.304260 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21077): Process ended prematurely: osmo-stp_10.42.42.5(pid=21077) [trial-2376↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21077)] [trial-2376↪ussd:trx-b200↪assert_extension.py:17] 15:55:36.313122 tst assert_extension.py:17: Test FAILED (5.9 sec) 15:55:36.340336 run osmo-hlr_10.42.42.2(pid=21074): ERR: Terminated: ERROR {rc=237} [trial-2376↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21074)] 15:55:36.390619 run osmo-hlr_10.42.42.2(pid=21074): stdout: | (launched: 2022-12-10_15:55:33.463176) 15:55:36.442424 run osmo-hlr_10.42.42.2(pid=21074): stderr: | [0;m[1;31m20221210155533661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155533661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155533661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155533661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155533661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155533661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155533674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155533684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155533684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155533684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:36.514497 run osmo-msc_10.42.42.6(pid=21080): ERR: Terminated: ERROR {rc=2} [trial-2376↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21080)] 15:55:36.564552 run osmo-msc_10.42.42.6(pid=21080): stdout: | (launched: 2022-12-10_15:55:35.410602) 15:55:36.616199 run osmo-msc_10.42.42.6(pid=21080): stderr: | [0;m[38;5;43m20221210155535730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155535730 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f28754c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155535730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155535730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155535730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155535730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155535732 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155535732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155535732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155535733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:55:36.668239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21073): Terminating (SIGTERM) 15:55:36.710074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21076): Terminating (SIGTERM) 15:55:36.751981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21079): Terminating (SIGTERM) 15:55:36.794117 --- ParallelTerminationStrategy: PID 21073 died... 15:55:36.814120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21073): Terminated: ok {rc=0} 15:55:36.860129 --- ParallelTerminationStrategy: PID 21076 died... 15:55:36.879454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21076): Terminated: ok {rc=0} 15:55:36.925474 --- ParallelTerminationStrategy: PID 21079 died... 15:55:36.944812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21079): Terminated: ok {rc=0} 15:55:37.031413 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:55:38.247462 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:38.255157 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:55:38.289977 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:55:38.316750 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:55:38.367854 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:55:38.400834 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:55:38.427611 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:55:38.976701 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:55:39.029325 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:39.041144 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:55:39.112165 tst mo_mt_call.py: using LAC 29028 15:55:39.235361 tst mo_mt_call.py: using RAC 213 15:55:39.353213 tst mo_mt_call.py: using CellId 29028 15:55:39.469447 tst mo_mt_call.py: using BVCI 29029 15:55:39.584437 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:39.596175 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:39.607585 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:39.619086 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:39.630606 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:39.642066 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:55:39.756579 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:55:39.872256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:40.361453 run create_hlr_db(pid=21085): Launched 15:55:40.489918 bus /sierra_2: Setting Powered False 15:55:41.552671 run create_hlr_db(pid=21085): Terminated: ok {rc=0} 15:55:41.976740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21087): Launched 15:55:42.271301 run osmo-hlr_10.42.42.2(pid=21088): Launched 15:55:42.383962 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:42.892084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21090): Launched 15:55:43.184743 run osmo-stp_10.42.42.5(pid=21091): Launched 15:55:43.296387 run osmo-msc_10.42.42.6: Starting osmo-msc 15:55:43.828022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21093): Launched 15:55:44.122182 run osmo-msc_10.42.42.6(pid=21094): Launched 15:55:44.286983 run osmo-stp_10.42.42.5(pid=21091): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21091)] 15:55:44.412768 run osmo-stp_10.42.42.5(pid=21091): stdout: | (launched: 2022-12-10_15:55:43.131360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:44.538435 run osmo-stp_10.42.42.5(pid=21091): stderr: | [0;m[38;5;43m20221210155543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155543300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:44.661657 run osmo-stp_10.42.42.5(pid=21091): stdout: | (launched: 2022-12-10_15:55:43.131360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:44.779050 run osmo-stp_10.42.42.5(pid=21091): stderr: | [0;m[38;5;43m20221210155543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155543300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:44.919887 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21091): Process ended prematurely: osmo-stp_10.42.42.5(pid=21091) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21091)] [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:55:44.928890 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 15:55:44.955630 run osmo-hlr_10.42.42.2(pid=21088): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21088)] 15:55:45.003176 run osmo-hlr_10.42.42.2(pid=21088): stdout: | (launched: 2022-12-10_15:55:42.217677) 15:55:45.052715 run osmo-hlr_10.42.42.2(pid=21088): stderr: | [0;m[1;31m20221210155542391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155542391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155542391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155542391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155542391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155542391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155542403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155542413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155542414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155542414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:45.121397 run osmo-msc_10.42.42.6(pid=21094): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21094)] 15:55:45.168893 run osmo-msc_10.42.42.6(pid=21094): stdout: | (launched: 2022-12-10_15:55:44.068755) 15:55:45.217896 run osmo-msc_10.42.42.6(pid=21094): stderr: | [0;m[38;5;43m20221210155544334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155544334 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe0cfbd9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155544334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155544334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155544334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155544335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155544338 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155544338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155544338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155544339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:55:45.267336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21087): Terminating (SIGTERM) 15:55:45.307061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21090): Terminating (SIGTERM) 15:55:45.346752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21093): Terminating (SIGTERM) 15:55:45.386681 --- ParallelTerminationStrategy: PID 21087 died... 15:55:45.405547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21087): Terminated: ok {rc=0} 15:55:45.449779 --- ParallelTerminationStrategy: PID 21090 died... 15:55:45.468181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21090): Terminated: ok {rc=0} 15:55:45.512594 --- ParallelTerminationStrategy: PID 21093 died... 15:55:45.531318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21093): Terminated: ok {rc=0} 15:55:45.617138 bus /sierra_3: Setting Powered False 15:55:46.727642 bus /sierra_3: Setting Powered False 15:55:47.858928 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:55:49.011788 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:49.023773 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:55:49.094981 tst mo_mt_call_osmux.py: using LAC 29029 15:55:49.221064 tst mo_mt_call_osmux.py: using RAC 214 15:55:49.344291 tst mo_mt_call_osmux.py: using CellId 29029 15:55:49.467891 tst mo_mt_call_osmux.py: using BVCI 29030 15:55:49.575459 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:49.586618 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:49.597620 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:49.608740 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:49.620059 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:49.631023 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:55:49.746454 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:55:49.860215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:50.349478 run create_hlr_db(pid=21096): Launched 15:55:50.477593 bus /sierra_2: Setting Powered False 15:55:51.540494 run create_hlr_db(pid=21096): Terminated: ok {rc=0} 15:55:51.963160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21098): Launched 15:55:52.257587 run osmo-hlr_10.42.42.2(pid=21099): Launched 15:55:52.370011 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:52.888725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21101): Launched 15:55:53.183129 run osmo-stp_10.42.42.5(pid=21102): Launched 15:55:53.294588 run osmo-msc_10.42.42.6: Starting osmo-msc 15:55:53.827082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21104): Launched 15:55:54.122167 run osmo-msc_10.42.42.6(pid=21105): Launched 15:55:54.285679 run osmo-stp_10.42.42.5(pid=21102): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21102)] 15:55:54.410810 run osmo-stp_10.42.42.5(pid=21102): stdout: | (launched: 2022-12-10_15:55:53.129699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:54.536300 run osmo-stp_10.42.42.5(pid=21102): stderr: | [0;m[38;5;43m20221210155553298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155553298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155553299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155553299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155553299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155553300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155553300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:54.660064 run osmo-stp_10.42.42.5(pid=21102): stdout: | (launched: 2022-12-10_15:55:53.129699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:54.778135 run osmo-stp_10.42.42.5(pid=21102): stderr: | [0;m[38;5;43m20221210155553298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155553298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155553299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155553299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155553299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155553300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155553300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:54.919200 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21102): Process ended prematurely: osmo-stp_10.42.42.5(pid=21102) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21102)] [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:55:54.928203 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 15:55:54.955183 run osmo-hlr_10.42.42.2(pid=21099): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21099)] 15:55:55.004187 run osmo-hlr_10.42.42.2(pid=21099): stdout: | (launched: 2022-12-10_15:55:52.203799) 15:55:55.054315 run osmo-hlr_10.42.42.2(pid=21099): stderr: | [0;m[1;31m20221210155552377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155552377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155552377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155552377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155552377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155552377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155552388 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155552397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155552397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155552397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:55.124419 run osmo-msc_10.42.42.6(pid=21105): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21105)] 15:55:55.172700 run osmo-msc_10.42.42.6(pid=21105): stdout: | (launched: 2022-12-10_15:55:54.068291) 15:55:55.222676 run osmo-msc_10.42.42.6(pid=21105): stderr: | [0;m[38;5;43m20221210155554336 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155554336 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff44e1b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155554336 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155554336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155554338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155554338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155554340 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155554340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155554340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155554340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:55:55.272802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21098): Terminating (SIGTERM) 15:55:55.313382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21101): Terminating (SIGTERM) 15:55:55.353950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21104): Terminating (SIGTERM) 15:55:55.394720 --- ParallelTerminationStrategy: PID 21098 died... 15:55:55.414030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21098): Terminated: ok {rc=0} 15:55:55.459226 --- ParallelTerminationStrategy: PID 21101 died... 15:55:55.478010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21101): Terminated: ok {rc=0} 15:55:55.523066 --- ParallelTerminationStrategy: PID 21104 died... 15:55:55.541909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21104): Terminated: ok {rc=0} 15:55:55.628563 bus /sierra_3: Setting Powered False 15:55:56.726296 bus /sierra_3: Setting Powered False 15:55:57.843306 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:55:59.098007 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:59.106913 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:55:59.141335 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:55:59.168445 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:55:59.221974 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:55:59.255381 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:55:59.282402 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:55:59.832773 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:55:59.882933 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:59.894303 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:55:59.962486 tst mo_mt_call.py: using LAC 29030 15:56:00.088375 tst mo_mt_call.py: using RAC 215 15:56:00.204856 tst mo_mt_call.py: using CellId 29030 15:56:00.318471 tst mo_mt_call.py: using BVCI 29031 15:56:00.425106 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:00.436161 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:00.447249 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:00.458472 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:00.469634 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:00.480531 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:56:00.597185 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:56:00.710199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:01.194893 run create_hlr_db(pid=21110): Launched 15:56:01.372039 bus /sierra_2: Setting Powered False 15:56:02.430939 run create_hlr_db(pid=21110): Terminated: ok {rc=0} 15:56:02.862542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21112): Launched 15:56:03.177612 run osmo-hlr_10.42.42.2(pid=21113): Launched 15:56:03.297427 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:03.841517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21115): Launched 15:56:04.156192 run osmo-stp_10.42.42.5(pid=21116): Launched 15:56:04.275143 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:04.844097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21118): Launched 15:56:05.158302 run osmo-msc_10.42.42.6(pid=21119): Launched 15:56:05.333138 run osmo-stp_10.42.42.5(pid=21116): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21116)] 15:56:05.465834 run osmo-stp_10.42.42.5(pid=21116): stdout: | (launched: 2022-12-10_15:56:04.098979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:05.599404 run osmo-stp_10.42.42.5(pid=21116): stderr: | [0;m[38;5;43m20221210155604289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155604289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155604289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155604290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155604290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155604290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155604290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:05.732029 run osmo-stp_10.42.42.5(pid=21116): stdout: | (launched: 2022-12-10_15:56:04.098979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:05.857999 run osmo-stp_10.42.42.5(pid=21116): stderr: | [0;m[38;5;43m20221210155604289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155604289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155604289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155604290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155604290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155604290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155604290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:06.008225 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21116): Process ended prematurely: osmo-stp_10.42.42.5(pid=21116) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21116)] [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:56:06.017669 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:56:06.045298 run osmo-hlr_10.42.42.2(pid=21113): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21113)] 15:56:06.095823 run osmo-hlr_10.42.42.2(pid=21113): stdout: | (launched: 2022-12-10_15:56:03.120266) 15:56:06.147901 run osmo-hlr_10.42.42.2(pid=21113): stderr: | [0;m[1;31m20221210155603318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155603318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155603318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155603318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155603318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155603318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155603332 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155603343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155603343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155603343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:06.220104 run osmo-msc_10.42.42.6(pid=21119): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21119)] 15:56:06.269933 run osmo-msc_10.42.42.6(pid=21119): stdout: | (launched: 2022-12-10_15:56:05.100854) 15:56:06.321485 run osmo-msc_10.42.42.6(pid=21119): stderr: | [0;m[38;5;43m20221210155605419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155605419 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5f0a3dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155605419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155605419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155605419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155605419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155605421 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155605422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155605422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155605422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:06.373263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21112): Terminating (SIGTERM) 15:56:06.415132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21115): Terminating (SIGTERM) 15:56:06.457178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21118): Terminating (SIGTERM) 15:56:06.499132 --- ParallelTerminationStrategy: PID 21112 died... 15:56:06.519170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21112): Terminated: ok {rc=0} 15:56:06.565750 --- ParallelTerminationStrategy: PID 21115 died... 15:56:06.585365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21115): Terminated: ok {rc=0} 15:56:06.631409 --- ParallelTerminationStrategy: PID 21118 died... 15:56:06.650935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21118): Terminated: ok {rc=0} 15:56:06.738582 bus /sierra_3: Setting Powered False 15:56:07.838465 bus /sierra_3: Setting Powered False 15:56:08.956462 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:56:10.101783 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:10.113750 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:56:10.183302 tst mo_mt_call_osmux.py: using LAC 29031 15:56:10.298300 tst mo_mt_call_osmux.py: using RAC 216 15:56:10.416806 tst mo_mt_call_osmux.py: using CellId 29031 15:56:10.541449 tst mo_mt_call_osmux.py: using BVCI 29032 15:56:10.657564 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:10.669157 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:10.680417 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:10.691838 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:10.703219 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:56:10.714609 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:56:10.829881 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:56:10.945096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:11.401243 run create_hlr_db(pid=21121): Launched 15:56:11.514392 bus /sierra_2: Setting Powered False 15:56:12.573930 run create_hlr_db(pid=21121): Terminated: ok {rc=0} 15:56:12.987280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21123): Launched 15:56:13.283044 run osmo-hlr_10.42.42.2(pid=21124): Launched 15:56:13.395047 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:13.910796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21126): Launched 15:56:14.205104 run osmo-stp_10.42.42.5(pid=21127): Launched 15:56:14.317289 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:14.855049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21129): Launched 15:56:15.149569 run osmo-msc_10.42.42.6(pid=21130): Launched 15:56:15.315209 run osmo-stp_10.42.42.5(pid=21127): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21127)] 15:56:15.441666 run osmo-stp_10.42.42.5(pid=21127): stdout: | (launched: 2022-12-10_15:56:14.151171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:15.568398 run osmo-stp_10.42.42.5(pid=21127): stderr: | [0;m[38;5;43m20221210155614318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155614318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155614318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155614319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155614319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155614319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155614319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:15.692338 run osmo-stp_10.42.42.5(pid=21127): stdout: | (launched: 2022-12-10_15:56:14.151171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:15.810625 run osmo-stp_10.42.42.5(pid=21127): stderr: | [0;m[38;5;43m20221210155614318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155614318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155614318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155614319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155614319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155614319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155614319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:15.965836 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21127): Process ended prematurely: osmo-stp_10.42.42.5(pid=21127) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21127)] [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:56:15.975605 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 15:56:16.005188 run osmo-hlr_10.42.42.2(pid=21124): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21124)] 15:56:16.055618 run osmo-hlr_10.42.42.2(pid=21124): stdout: | (launched: 2022-12-10_15:56:13.229646) 15:56:16.107634 run osmo-hlr_10.42.42.2(pid=21124): stderr: | [0;m[1;31m20221210155613402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155613402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155613402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155613402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155613402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155613403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155613415 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155613425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155613425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155613425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:16.179881 run osmo-msc_10.42.42.6(pid=21130): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21130)] 15:56:16.230551 run osmo-msc_10.42.42.6(pid=21130): stdout: | (launched: 2022-12-10_15:56:15.095719) 15:56:16.283032 run osmo-msc_10.42.42.6(pid=21130): stderr: | [0;m[38;5;43m20221210155615364 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155615365 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6d7a0c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155615365 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155615365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155615365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155615365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155615367 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155615368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155615368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155615368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:16.336476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21123): Terminating (SIGTERM) 15:56:16.379676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21126): Terminating (SIGTERM) 15:56:16.422730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21129): Terminating (SIGTERM) 15:56:16.465942 --- ParallelTerminationStrategy: PID 21123 died... 15:56:16.485817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21123): Terminated: ok {rc=0} 15:56:16.533660 --- ParallelTerminationStrategy: PID 21126 died... 15:56:16.553311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21126): Terminated: ok {rc=0} 15:56:16.601285 --- ParallelTerminationStrategy: PID 21129 died... 15:56:16.621050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21129): Terminated: ok {rc=0} 15:56:16.710563 bus /sierra_3: Setting Powered False 15:56:17.811476 bus /sierra_3: Setting Powered False 15:56:18.925458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:56:20.178125 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:20.185162 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:56:20.218986 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:56:20.246179 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:56:20.299580 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:56:20.333195 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:56:20.360090 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:56:20.911061 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:56:20.961698 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:20.973202 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:56:21.043491 tst mo_mt_call.py: using LAC 29032 15:56:21.169375 tst mo_mt_call.py: using RAC 217 15:56:21.294334 tst mo_mt_call.py: using CellId 29032 15:56:21.419713 tst mo_mt_call.py: using BVCI 29033 15:56:21.533816 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:21.545394 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:21.556657 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:21.568146 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:21.579577 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:21.590956 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:56:21.709716 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:56:21.826629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:22.315395 run create_hlr_db(pid=21135): Launched 15:56:22.434468 bus /sierra_2: Setting Powered False 15:56:23.493822 run create_hlr_db(pid=21135): Terminated: ok {rc=0} 15:56:23.925400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Launched 15:56:24.242243 run osmo-hlr_10.42.42.2(pid=21138): Launched 15:56:24.361996 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:24.909655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Launched 15:56:25.223951 run osmo-stp_10.42.42.5(pid=21141): Launched 15:56:25.342829 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:25.912942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21143): Launched 15:56:26.228473 run osmo-msc_10.42.42.6(pid=21144): Launched 15:56:26.404561 run osmo-stp_10.42.42.5(pid=21141): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] 15:56:26.537863 run osmo-stp_10.42.42.5(pid=21141): stdout: | (launched: 2022-12-10_15:56:25.167019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:26.672293 run osmo-stp_10.42.42.5(pid=21141): stderr: | [0;m[38;5;43m20221210155625358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155625358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155625359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155625359 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155625359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155625359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155625359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:26.805574 run osmo-stp_10.42.42.5(pid=21141): stdout: | (launched: 2022-12-10_15:56:25.167019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:26.931664 run osmo-stp_10.42.42.5(pid=21141): stderr: | [0;m[38;5;43m20221210155625358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155625358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155625359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155625359 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155625359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155625359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155625359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:27.082609 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21141): Process ended prematurely: osmo-stp_10.42.42.5(pid=21141) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:56:27.092007 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:56:27.119836 run osmo-hlr_10.42.42.2(pid=21138): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21138)] 15:56:27.170524 run osmo-hlr_10.42.42.2(pid=21138): stdout: | (launched: 2022-12-10_15:56:24.184409) 15:56:27.222557 run osmo-hlr_10.42.42.2(pid=21138): stderr: | [0;m[1;31m20221210155624381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155624381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155624381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155624382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155624382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155624382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155624394 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155624402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155624403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155624403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:27.294999 run osmo-msc_10.42.42.6(pid=21144): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21144)] 15:56:27.345449 run osmo-msc_10.42.42.6(pid=21144): stdout: | (launched: 2022-12-10_15:56:26.171099) 15:56:27.397343 run osmo-msc_10.42.42.6(pid=21144): stderr: | [0;m[38;5;43m20221210155626491 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155626491 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2a75d29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155626491 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155626491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155626491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155626491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155626493 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155626494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155626494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155626494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:27.449464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Terminating (SIGTERM) 15:56:27.491272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Terminating (SIGTERM) 15:56:27.533211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21143): Terminating (SIGTERM) 15:56:27.575307 --- ParallelTerminationStrategy: PID 21137 died... 15:56:27.595010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Terminated: ok {rc=0} 15:56:27.641457 --- ParallelTerminationStrategy: PID 21140 died... 15:56:27.661080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Terminated: ok {rc=0} 15:56:27.707396 --- ParallelTerminationStrategy: PID 21143 died... 15:56:27.727063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21143): Terminated: ok {rc=0} 15:56:27.814671 bus /sierra_3: Setting Powered False 15:56:28.913283 bus /sierra_3: Setting Powered False 15:56:30.030509 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:56:31.175410 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:31.188152 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:56:31.261028 tst mo_mt_call_osmux.py: using LAC 29033 15:56:31.391860 tst mo_mt_call_osmux.py: using RAC 218 15:56:31.511004 tst mo_mt_call_osmux.py: using CellId 29033 15:56:31.667658 tst mo_mt_call_osmux.py: using BVCI 29034 15:56:31.819258 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:31.835046 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:31.850981 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:31.865403 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:31.880358 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:31.897946 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:56:32.028761 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:56:32.147813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:32.641274 run create_hlr_db(pid=21146): Launched 15:56:32.769748 bus /sierra_2: Setting Powered False 15:56:33.832553 run create_hlr_db(pid=21146): Terminated: ok {rc=0} 15:56:34.254500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21148): Launched 15:56:34.549692 run osmo-hlr_10.42.42.2(pid=21149): Launched 15:56:34.662341 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:35.181877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21151): Launched 15:56:35.475481 run osmo-stp_10.42.42.5(pid=21152): Launched 15:56:35.587657 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:36.121722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21154): Launched 15:56:36.439057 run osmo-msc_10.42.42.6(pid=21155): Launched 15:56:36.613750 run osmo-stp_10.42.42.5(pid=21152): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21152)] 15:56:36.745696 run osmo-stp_10.42.42.5(pid=21152): stdout: | (launched: 2022-12-10_15:56:35.421869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:36.878636 run osmo-stp_10.42.42.5(pid=21152): stderr: | [0;m[38;5;43m20221210155635591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155635591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155635591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155635592 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155635592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155635592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155635592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:37.011025 run osmo-stp_10.42.42.5(pid=21152): stdout: | (launched: 2022-12-10_15:56:35.421869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:37.136838 run osmo-stp_10.42.42.5(pid=21152): stderr: | [0;m[38;5;43m20221210155635591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155635591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155635591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155635592 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155635592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155635592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155635592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:37.287958 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21152): Process ended prematurely: osmo-stp_10.42.42.5(pid=21152) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21152)] [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:56:37.297482 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:56:37.325194 run osmo-hlr_10.42.42.2(pid=21149): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21149)] 15:56:37.374961 run osmo-hlr_10.42.42.2(pid=21149): stdout: | (launched: 2022-12-10_15:56:34.496271) 15:56:37.426695 run osmo-hlr_10.42.42.2(pid=21149): stderr: | [0;m[1;31m20221210155634671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155634671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155634671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155634671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155634671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155634671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155634684 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155634694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155634694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155634695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:37.498852 run osmo-msc_10.42.42.6(pid=21155): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21155)] 15:56:37.548609 run osmo-msc_10.42.42.6(pid=21155): stdout: | (launched: 2022-12-10_15:56:36.382112) 15:56:37.600342 run osmo-msc_10.42.42.6(pid=21155): stderr: | [0;m[38;5;43m20221210155636702 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155636703 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd7aee3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155636703 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155636703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155636703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155636703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155636705 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155636705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155636705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155636706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:37.652220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21148): Terminating (SIGTERM) 15:56:37.693769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21151): Terminating (SIGTERM) 15:56:37.735379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21154): Terminating (SIGTERM) 15:56:37.777255 --- ParallelTerminationStrategy: PID 21148 died... 15:56:37.797345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21148): Terminated: ok {rc=0} 15:56:37.843654 --- ParallelTerminationStrategy: PID 21151 died... 15:56:37.863205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21151): Terminated: ok {rc=0} 15:56:37.909818 --- ParallelTerminationStrategy: PID 21154 died... 15:56:37.929317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21154): Terminated: ok {rc=0} 15:56:38.016607 bus /sierra_3: Setting Powered False 15:56:39.114883 bus /sierra_3: Setting Powered False 15:56:40.229110 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:56:41.481897 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:41.488805 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:56:41.522791 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:56:41.550111 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:56:41.603395 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:56:41.637504 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:56:41.664912 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:56:42.214937 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:56:42.265203 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:42.276659 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:56:42.347284 tst mo_mt_call.py: using LAC 29034 15:56:42.471938 tst mo_mt_call.py: using RAC 219 15:56:42.595389 tst mo_mt_call.py: using CellId 29034 15:56:42.717542 tst mo_mt_call.py: using BVCI 29035 15:56:42.828193 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:42.839409 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:42.850414 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:42.861635 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:42.873066 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:42.884312 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:56:43.000259 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:56:43.114747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:43.573090 run create_hlr_db(pid=21161): Launched 15:56:43.685495 bus /sierra_2: Setting Powered False 15:56:44.744465 run create_hlr_db(pid=21161): Terminated: ok {rc=0} 15:56:45.177774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21163): Launched 15:56:45.494659 run osmo-hlr_10.42.42.2(pid=21164): Launched 15:56:45.615288 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:46.213943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21166): Launched 15:56:46.542793 run osmo-stp_10.42.42.5(pid=21167): Launched 15:56:46.683872 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:47.408311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21169): Launched 15:56:47.724435 run osmo-msc_10.42.42.6(pid=21170): Launched 15:56:47.899601 run osmo-stp_10.42.42.5(pid=21167): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21167)] 15:56:48.032355 run osmo-stp_10.42.42.5(pid=21167): stdout: | (launched: 2022-12-10_15:56:46.479877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:48.166275 run osmo-stp_10.42.42.5(pid=21167): stderr: | [0;m[38;5;43m20221210155646822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155646822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155646822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155646822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155646837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155646837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155646837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:48.299341 run osmo-stp_10.42.42.5(pid=21167): stdout: | (launched: 2022-12-10_15:56:46.479877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:48.426138 run osmo-stp_10.42.42.5(pid=21167): stderr: | [0;m[38;5;43m20221210155646822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155646822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155646822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155646822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155646837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155646837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155646837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:48.576651 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21167): Process ended prematurely: osmo-stp_10.42.42.5(pid=21167) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21167)] [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:56:48.586255 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 15:56:48.614238 run osmo-hlr_10.42.42.2(pid=21164): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21164)] 15:56:48.664255 run osmo-hlr_10.42.42.2(pid=21164): stdout: | (launched: 2022-12-10_15:56:45.437587) 15:56:48.716223 run osmo-hlr_10.42.42.2(pid=21164): stderr: | [0;m[1;31m20221210155645634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155645634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155645634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155645634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155645634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155645634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155645646 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155645655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155645655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155645655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:48.788013 run osmo-msc_10.42.42.6(pid=21170): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21170)] 15:56:48.838062 run osmo-msc_10.42.42.6(pid=21170): stdout: | (launched: 2022-12-10_15:56:47.667382) 15:56:48.889734 run osmo-msc_10.42.42.6(pid=21170): stderr: | [0;m[38;5;43m20221210155647989 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155647989 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f60e858cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155647989 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155647989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155647990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155647990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155647991 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155647992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155647992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155647992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:48.941526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21163): Terminating (SIGTERM) 15:56:48.983040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21166): Terminating (SIGTERM) 15:56:49.024784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21169): Terminating (SIGTERM) 15:56:49.066873 --- ParallelTerminationStrategy: PID 21163 died... 15:56:49.086772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21163): Terminated: ok {rc=0} 15:56:49.133027 --- ParallelTerminationStrategy: PID 21166 died... 15:56:49.152700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21166): Terminated: ok {rc=0} 15:56:49.199176 --- ParallelTerminationStrategy: PID 21169 died... 15:56:49.218796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21169): Terminated: ok {rc=0} 15:56:49.306197 bus /sierra_3: Setting Powered False 15:56:50.405732 bus /sierra_3: Setting Powered False 15:56:51.521239 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:56:52.663699 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:52.675211 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:56:52.746925 tst mo_mt_call_osmux.py: using LAC 29035 15:56:52.862207 tst mo_mt_call_osmux.py: using RAC 220 15:56:52.977320 tst mo_mt_call_osmux.py: using CellId 29035 15:56:53.093280 tst mo_mt_call_osmux.py: using BVCI 29036 15:56:53.199919 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:53.210945 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:53.221848 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:53.232884 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:53.244036 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:53.255184 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:56:53.367510 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:56:53.484254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:53.972441 run create_hlr_db(pid=21172): Launched 15:56:54.101076 bus /sierra_2: Setting Powered False 15:56:55.163900 run create_hlr_db(pid=21172): Terminated: ok {rc=0} 15:56:55.602580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21174): Launched 15:56:55.915766 run osmo-hlr_10.42.42.2(pid=21175): Launched 15:56:56.034415 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:56.580905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21177): Launched 15:56:56.895360 run osmo-stp_10.42.42.5(pid=21178): Launched 15:56:57.014851 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:57.585791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21180): Launched 15:56:57.900591 run osmo-msc_10.42.42.6(pid=21181): Launched 15:56:58.078152 run osmo-stp_10.42.42.5(pid=21178): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21178)] 15:56:58.211313 run osmo-stp_10.42.42.5(pid=21178): stdout: | (launched: 2022-12-10_15:56:56.838252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:58.345369 run osmo-stp_10.42.42.5(pid=21178): stderr: | [0;m[38;5;43m20221210155657028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155657028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155657028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155657029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155657031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155657031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155657031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:58.478516 run osmo-stp_10.42.42.5(pid=21178): stdout: | (launched: 2022-12-10_15:56:56.838252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:58.604423 run osmo-stp_10.42.42.5(pid=21178): stderr: | [0;m[38;5;43m20221210155657028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155657028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155657028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155657029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155657031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155657031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155657031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:58.754579 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21178): Process ended prematurely: osmo-stp_10.42.42.5(pid=21178) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21178)] [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:56:58.763811 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 15:56:58.791464 run osmo-hlr_10.42.42.2(pid=21175): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21175)] 15:56:58.841555 run osmo-hlr_10.42.42.2(pid=21175): stdout: | (launched: 2022-12-10_15:56:55.859003) 15:56:58.893352 run osmo-hlr_10.42.42.2(pid=21175): stderr: | [0;m[1;31m20221210155656056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155656056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155656056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155656056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155656056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155656056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155656069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155656077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155656077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155656077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:58.965523 run osmo-msc_10.42.42.6(pid=21181): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21181)] 15:56:59.015509 run osmo-msc_10.42.42.6(pid=21181): stdout: | (launched: 2022-12-10_15:56:57.843575) 15:56:59.067142 run osmo-msc_10.42.42.6(pid=21181): stderr: | [0;m[38;5;43m20221210155658169 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155658169 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f513ed8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155658169 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155658169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155658169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155658170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155658171 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155658172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155658172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155658172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:59.119083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21174): Terminating (SIGTERM) 15:56:59.160679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21177): Terminating (SIGTERM) 15:56:59.202702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21180): Terminating (SIGTERM) 15:56:59.244872 --- ParallelTerminationStrategy: PID 21174 died... 15:56:59.264530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21174): Terminated: ok {rc=0} 15:56:59.310963 --- ParallelTerminationStrategy: PID 21177 died... 15:56:59.330452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21177): Terminated: ok {rc=0} 15:56:59.376625 --- ParallelTerminationStrategy: PID 21180 died... 15:56:59.396185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21180): Terminated: ok {rc=0} 15:56:59.483579 bus /sierra_3: Setting Powered False 15:57:00.581577 bus /sierra_3: Setting Powered False 15:57:01.701426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:57:02.947804 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:57:02.956024 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:57:02.989910 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:57:03.017251 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:57:03.071382 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:57:03.105281 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:57:03.132427 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:57:03.683063 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:57:03.733514 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:03.745201 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:57:03.815677 tst mo_mt_call.py: using LAC 29036 15:57:03.936824 tst mo_mt_call.py: using RAC 221 15:57:04.051725 tst mo_mt_call.py: using CellId 29036 15:57:04.166021 tst mo_mt_call.py: using BVCI 29037 15:57:04.272833 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:04.283983 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:04.294899 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:04.306216 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:04.317747 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:04.328732 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:57:04.446646 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:57:04.561801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:05.018550 run create_hlr_db(pid=21186): Launched 15:57:05.130469 bus /sierra_2: Setting Powered False 15:57:06.189948 run create_hlr_db(pid=21186): Terminated: ok {rc=0} 15:57:06.603537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21188): Launched 15:57:06.897549 run osmo-hlr_10.42.42.2(pid=21189): Launched 15:57:07.010117 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:07.528804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21191): Launched 15:57:07.823828 run osmo-stp_10.42.42.5(pid=21192): Launched 15:57:07.935880 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:08.468755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21194): Launched 15:57:08.764176 run osmo-msc_10.42.42.6(pid=21195): Launched 15:57:08.928432 run osmo-stp_10.42.42.5(pid=21192): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21192)] 15:57:09.053404 run osmo-stp_10.42.42.5(pid=21192): stdout: | (launched: 2022-12-10_15:57:07.770371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:09.178941 run osmo-stp_10.42.42.5(pid=21192): stderr: | [0;m[38;5;43m20221210155707940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155707940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155707941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155707941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155707941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155707942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155707942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:09.303335 run osmo-stp_10.42.42.5(pid=21192): stdout: | (launched: 2022-12-10_15:57:07.770371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:09.421869 run osmo-stp_10.42.42.5(pid=21192): stderr: | [0;m[38;5;43m20221210155707940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155707940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155707941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155707941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155707941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155707942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155707942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:09.563158 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21192): Process ended prematurely: osmo-stp_10.42.42.5(pid=21192) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21192)] [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:57:09.572101 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 15:57:09.599142 run osmo-hlr_10.42.42.2(pid=21189): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21189)] 15:57:09.647847 run osmo-hlr_10.42.42.2(pid=21189): stdout: | (launched: 2022-12-10_15:57:06.844025) 15:57:09.697929 run osmo-hlr_10.42.42.2(pid=21189): stderr: | [0;m[1;31m20221210155707021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155707021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155707021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155707021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155707021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155707022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155707034 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155707042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155707042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155707042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:09.767528 run osmo-msc_10.42.42.6(pid=21195): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21195)] 15:57:09.815595 run osmo-msc_10.42.42.6(pid=21195): stdout: | (launched: 2022-12-10_15:57:08.710252) 15:57:09.865481 run osmo-msc_10.42.42.6(pid=21195): stderr: | [0;m[38;5;43m20221210155708981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155708981 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0876a1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155708981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155708981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155708981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155708982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155708983 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155708984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155708984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155708984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:09.915806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21188): Terminating (SIGTERM) 15:57:09.955737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21191): Terminating (SIGTERM) 15:57:09.995769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21194): Terminating (SIGTERM) 15:57:10.035842 --- ParallelTerminationStrategy: PID 21188 died... 15:57:10.055044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21188): Terminated: ok {rc=0} 15:57:10.100544 --- ParallelTerminationStrategy: PID 21191 died... 15:57:10.119269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21191): Terminated: ok {rc=0} 15:57:10.164148 --- ParallelTerminationStrategy: PID 21194 died... 15:57:10.182905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21194): Terminated: ok {rc=0} 15:57:10.267623 bus /sierra_3: Setting Powered False 15:57:11.366484 bus /sierra_3: Setting Powered False 15:57:12.481231 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:57:13.629785 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:13.642253 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:57:13.712371 tst mo_mt_call_osmux.py: using LAC 29037 15:57:13.834808 tst mo_mt_call_osmux.py: using RAC 222 15:57:13.956905 tst mo_mt_call_osmux.py: using CellId 29037 15:57:14.079178 tst mo_mt_call_osmux.py: using BVCI 29038 15:57:14.196157 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:14.207612 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:14.218910 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:14.230363 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:14.241762 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:14.253037 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:57:14.369362 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:57:14.486677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:14.976638 run create_hlr_db(pid=21197): Launched 15:57:15.104259 bus /sierra_2: Setting Powered False 15:57:16.167497 run create_hlr_db(pid=21197): Terminated: ok {rc=0} 15:57:16.627590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21199): Launched 15:57:16.972139 run osmo-hlr_10.42.42.2(pid=21200): Launched 15:57:17.189497 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:17.697618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21202): Launched 15:57:17.992873 run osmo-stp_10.42.42.5(pid=21203): Launched 15:57:18.105391 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:18.639084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21205): Launched 15:57:18.935054 run osmo-msc_10.42.42.6(pid=21206): Launched 15:57:19.098762 run osmo-stp_10.42.42.5(pid=21203): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21203)] 15:57:19.223646 run osmo-stp_10.42.42.5(pid=21203): stdout: | (launched: 2022-12-10_15:57:17.939366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:19.350125 run osmo-stp_10.42.42.5(pid=21203): stderr: | [0;m[38;5;43m20221210155718107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155718107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155718107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155718107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155718108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155718108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155718108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:19.473932 run osmo-stp_10.42.42.5(pid=21203): stdout: | (launched: 2022-12-10_15:57:17.939366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:19.592095 run osmo-stp_10.42.42.5(pid=21203): stderr: | [0;m[38;5;43m20221210155718107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155718107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155718107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155718107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155718108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155718108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155718108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:19.733453 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21203): Process ended prematurely: osmo-stp_10.42.42.5(pid=21203) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21203)] [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:57:19.742410 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:57:19.769117 run osmo-hlr_10.42.42.2(pid=21200): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21200)] 15:57:19.817378 run osmo-hlr_10.42.42.2(pid=21200): stdout: | (launched: 2022-12-10_15:57:16.898186) 15:57:19.867083 run osmo-hlr_10.42.42.2(pid=21200): stderr: | [0;m[1;31m20221210155717180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155717180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155717180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155717180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155717180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155717180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155717192 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155717200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155717201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155717201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:19.936516 run osmo-msc_10.42.42.6(pid=21206): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21206)] 15:57:19.984478 run osmo-msc_10.42.42.6(pid=21206): stdout: | (launched: 2022-12-10_15:57:18.881292) 15:57:20.034131 run osmo-msc_10.42.42.6(pid=21206): stderr: | [0;m[38;5;43m20221210155719154 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155719154 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc81e6b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155719154 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155719154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155719154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155719155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155719156 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155719157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155719157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155719157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:20.084154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21199): Terminating (SIGTERM) 15:57:20.124097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21202): Terminating (SIGTERM) 15:57:20.164227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21205): Terminating (SIGTERM) 15:57:20.204440 --- ParallelTerminationStrategy: PID 21199 died... 15:57:20.223595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21199): Terminated: ok {rc=0} 15:57:20.268383 --- ParallelTerminationStrategy: PID 21202 died... 15:57:20.287123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21202): Terminated: ok {rc=0} 15:57:20.331642 --- ParallelTerminationStrategy: PID 21205 died... 15:57:20.350256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21205): Terminated: ok {rc=0} 15:57:20.435883 bus /sierra_3: Setting Powered False 15:57:21.536003 bus /sierra_3: Setting Powered False 15:57:22.651738 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:57:23.906757 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:57:23.913715 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:57:23.947640 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:57:23.975363 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:57:24.027469 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:57:24.061390 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:57:24.088728 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:57:24.645561 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:57:24.696196 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:24.707945 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:57:24.778745 tst mo_mt_call.py: using LAC 29038 15:57:24.903616 tst mo_mt_call.py: using RAC 223 15:57:25.028529 tst mo_mt_call.py: using CellId 29038 15:57:25.152792 tst mo_mt_call.py: using BVCI 29039 15:57:25.260184 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:25.271553 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:25.282547 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:25.294013 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:25.305204 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:25.316287 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:57:25.428043 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:57:25.547156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:26.003051 run create_hlr_db(pid=21211): Launched 15:57:26.114421 bus /sierra_2: Setting Powered False 15:57:27.173920 run create_hlr_db(pid=21211): Terminated: ok {rc=0} 15:57:27.604086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21213): Launched 15:57:27.903174 run osmo-hlr_10.42.42.2(pid=21214): Launched 15:57:28.014604 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:28.518729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21216): Launched 15:57:28.813420 run osmo-stp_10.42.42.5(pid=21217): Launched 15:57:28.925007 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:29.458270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21219): Launched 15:57:29.753095 run osmo-msc_10.42.42.6(pid=21220): Launched 15:57:29.917867 run osmo-stp_10.42.42.5(pid=21217): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21217)] 15:57:30.043246 run osmo-stp_10.42.42.5(pid=21217): stdout: | (launched: 2022-12-10_15:57:28.759756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:30.168839 run osmo-stp_10.42.42.5(pid=21217): stderr: | [0;m[38;5;43m20221210155728927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155728927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155728928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155728928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155728929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155728929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155728929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:30.292326 run osmo-stp_10.42.42.5(pid=21217): stdout: | (launched: 2022-12-10_15:57:28.759756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:30.410033 run osmo-stp_10.42.42.5(pid=21217): stderr: | [0;m[38;5;43m20221210155728927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155728927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155728928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155728928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155728929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155728929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155728929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:30.550768 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21217): Process ended prematurely: osmo-stp_10.42.42.5(pid=21217) [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21217)] [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:57:30.559737 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 15:57:30.586175 run osmo-hlr_10.42.42.2(pid=21214): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21214)] 15:57:30.633996 run osmo-hlr_10.42.42.2(pid=21214): stdout: | (launched: 2022-12-10_15:57:27.849525) 15:57:30.683234 run osmo-hlr_10.42.42.2(pid=21214): stderr: | [0;m[1;31m20221210155728023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155728023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155728023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155728023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155728023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155728023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155728058 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155728069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155728070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155728070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:30.751777 run osmo-msc_10.42.42.6(pid=21220): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21220)] 15:57:30.799211 run osmo-msc_10.42.42.6(pid=21220): stdout: | (launched: 2022-12-10_15:57:29.698972) 15:57:30.869412 run osmo-msc_10.42.42.6(pid=21220): stderr: | [0;m[38;5;43m20221210155729967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155729968 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b36159c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155729968 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155729968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155729968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155729968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155729970 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155729970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155729971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155729971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:30.925784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21213): Terminating (SIGTERM) 15:57:30.974356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21216): Terminating (SIGTERM) 15:57:31.027116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21219): Terminating (SIGTERM) 15:57:31.070126 --- ParallelTerminationStrategy: PID 21213 died... 15:57:31.089787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21213): Terminated: ok {rc=0} 15:57:31.136260 --- ParallelTerminationStrategy: PID 21216 died... 15:57:31.155732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21216): Terminated: ok {rc=0} 15:57:31.201945 --- ParallelTerminationStrategy: PID 21219 died... 15:57:31.221542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21219): Terminated: ok {rc=0} 15:57:31.309748 bus /sierra_3: Setting Powered False 15:57:32.411019 bus /sierra_3: Setting Powered False 15:57:33.526069 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:57:34.674118 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:34.686245 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:57:34.756645 tst mo_mt_call_osmux.py: using LAC 29039 15:57:34.882913 tst mo_mt_call_osmux.py: using RAC 224 15:57:35.004878 tst mo_mt_call_osmux.py: using CellId 29039 15:57:35.126671 tst mo_mt_call_osmux.py: using BVCI 29040 15:57:35.241530 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:35.253083 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:35.264361 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:35.275694 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:35.287097 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:35.298520 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:57:35.413283 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:57:35.527313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:35.986212 run create_hlr_db(pid=21222): Launched 15:57:36.104220 bus /sierra_2: Setting Powered False 15:57:37.163932 run create_hlr_db(pid=21222): Terminated: ok {rc=0} 15:57:37.597064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21225): Launched 15:57:37.913135 run osmo-hlr_10.42.42.2(pid=21226): Launched 15:57:38.033581 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:38.582272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21228): Launched 15:57:38.897442 run osmo-stp_10.42.42.5(pid=21229): Launched 15:57:39.019423 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:39.590916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21231): Launched 15:57:39.905726 run osmo-msc_10.42.42.6(pid=21232): Launched 15:57:40.081183 run osmo-stp_10.42.42.5(pid=21229): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21229)] 15:57:40.213940 run osmo-stp_10.42.42.5(pid=21229): stdout: | (launched: 2022-12-10_15:57:38.840582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:40.347520 run osmo-stp_10.42.42.5(pid=21229): stderr: | [0;m[38;5;43m20221210155739031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155739031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155739031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155739031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155739032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155739032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155739032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:40.480563 run osmo-stp_10.42.42.5(pid=21229): stdout: | (launched: 2022-12-10_15:57:38.840582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:40.606870 run osmo-stp_10.42.42.5(pid=21229): stderr: | [0;m[38;5;43m20221210155739031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155739031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155739031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155739031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155739032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155739032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155739032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:40.757587 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21229): Process ended prematurely: osmo-stp_10.42.42.5(pid=21229) [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21229)] [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:57:40.767160 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 15:57:40.794815 run osmo-hlr_10.42.42.2(pid=21226): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21226)] 15:57:40.844829 run osmo-hlr_10.42.42.2(pid=21226): stdout: | (launched: 2022-12-10_15:57:37.855939) 15:57:40.896454 run osmo-hlr_10.42.42.2(pid=21226): stderr: | [0;m[1;31m20221210155738052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155738052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155738052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155738052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155738052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155738052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155738064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155738073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155738073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155738073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:40.968362 run osmo-msc_10.42.42.6(pid=21232): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21232)] 15:57:41.017775 run osmo-msc_10.42.42.6(pid=21232): stdout: | (launched: 2022-12-10_15:57:39.848693) 15:57:41.068896 run osmo-msc_10.42.42.6(pid=21232): stderr: | [0;m[38;5;43m20221210155740171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155740172 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efcea889c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155740172 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155740172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155740172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155740172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155740174 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155740174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155740174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155740175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:41.120203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21225): Terminating (SIGTERM) 15:57:41.161441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21228): Terminating (SIGTERM) 15:57:41.203253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21231): Terminating (SIGTERM) 15:57:41.244887 --- ParallelTerminationStrategy: PID 21225 died... 15:57:41.264809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21225): Terminated: ok {rc=0} 15:57:41.310699 --- ParallelTerminationStrategy: PID 21228 died... 15:57:41.330156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21228): Terminated: ok {rc=0} 15:57:41.375900 --- ParallelTerminationStrategy: PID 21231 died... 15:57:41.395185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21231): Terminated: ok {rc=0} 15:57:41.482238 bus /sierra_3: Setting Powered False 15:57:42.581638 bus /sierra_3: Setting Powered False 15:57:43.696676 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:57:44.944629 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:57:44.950699 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:57:44.984029 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:57:45.010329 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:57:45.062427 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:57:45.096803 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:57:45.122940 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:57:45.668490 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:57:45.716450 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:45.727340 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:57:45.796826 tst mo_mt_call.py: using LAC 29040 15:57:45.947350 tst mo_mt_call.py: using RAC 225 15:57:46.080843 tst mo_mt_call.py: using CellId 29040 15:57:46.216444 tst mo_mt_call.py: using BVCI 29041 15:57:46.335865 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:46.350212 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:46.363388 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:46.375566 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:46.388383 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:46.401282 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:57:46.522564 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:57:46.644422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:47.121538 run create_hlr_db(pid=21237): Launched 15:57:47.271763 bus /sierra_2: Setting Powered False 15:57:48.331661 run create_hlr_db(pid=21237): Terminated: ok {rc=0} 15:57:48.765471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21239): Launched 15:57:49.081667 run osmo-hlr_10.42.42.2(pid=21240): Launched 15:57:49.202568 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:49.751624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21242): Launched 15:57:50.066699 run osmo-stp_10.42.42.5(pid=21243): Launched 15:57:50.186723 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:50.758423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21245): Launched 15:57:51.074706 run osmo-msc_10.42.42.6(pid=21246): Launched 15:57:51.250417 run osmo-stp_10.42.42.5(pid=21243): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21243)] 15:57:51.383425 run osmo-stp_10.42.42.5(pid=21243): stdout: | (launched: 2022-12-10_15:57:50.009665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:51.517229 run osmo-stp_10.42.42.5(pid=21243): stderr: | [0;m[38;5;43m20221210155750202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155750202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155750202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155750203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155750203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155750203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155750203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:51.650575 run osmo-stp_10.42.42.5(pid=21243): stdout: | (launched: 2022-12-10_15:57:50.009665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:51.776828 run osmo-stp_10.42.42.5(pid=21243): stderr: | [0;m[38;5;43m20221210155750202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155750202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155750202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155750203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155750203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155750203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155750203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:51.927977 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21243): Process ended prematurely: osmo-stp_10.42.42.5(pid=21243) [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21243)] [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:57:51.937787 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:57:51.966177 run osmo-hlr_10.42.42.2(pid=21240): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21240)] 15:57:52.016209 run osmo-hlr_10.42.42.2(pid=21240): stdout: | (launched: 2022-12-10_15:57:49.024577) 15:57:52.068071 run osmo-hlr_10.42.42.2(pid=21240): stderr: | [0;m[1;31m20221210155749221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155749221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155749221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155749221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155749222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155749222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155749238 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155749247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155749248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155749248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:52.140379 run osmo-msc_10.42.42.6(pid=21246): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21246)] 15:57:52.190329 run osmo-msc_10.42.42.6(pid=21246): stdout: | (launched: 2022-12-10_15:57:51.017656) 15:57:52.242186 run osmo-msc_10.42.42.6(pid=21246): stderr: | [0;m[38;5;43m20221210155751337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155751337 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9298e61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155751337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155751337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155751337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155751338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155751339 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155751340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155751340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155751340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:52.294199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21239): Terminating (SIGTERM) 15:57:52.335826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21242): Terminating (SIGTERM) 15:57:52.378067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21245): Terminating (SIGTERM) 15:57:52.420000 --- ParallelTerminationStrategy: PID 21239 died... 15:57:52.439743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21239): Terminated: ok {rc=0} 15:57:52.486105 --- ParallelTerminationStrategy: PID 21242 died... 15:57:52.505760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21242): Terminated: ok {rc=0} 15:57:52.551832 --- ParallelTerminationStrategy: PID 21245 died... 15:57:52.571298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21245): Terminated: ok {rc=0} 15:57:52.659045 bus /sierra_3: Setting Powered False 15:57:53.758454 bus /sierra_3: Setting Powered False 15:57:54.874469 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:57:56.023167 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:56.035305 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:57:56.108153 tst mo_mt_call_osmux.py: using LAC 29041 15:57:56.232712 tst mo_mt_call_osmux.py: using RAC 226 15:57:56.358837 tst mo_mt_call_osmux.py: using CellId 29041 15:57:56.484626 tst mo_mt_call_osmux.py: using BVCI 29042 15:57:56.594221 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:56.605356 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:56.616266 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:56.627429 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:56.638620 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:56.649726 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:57:56.768081 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:57:56.886497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:57.377054 run create_hlr_db(pid=21248): Launched 15:57:57.506002 bus /sierra_2: Setting Powered False 15:57:58.569499 run create_hlr_db(pid=21248): Terminated: ok {rc=0} 15:57:58.993800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21250): Launched 15:57:59.291187 run osmo-hlr_10.42.42.2(pid=21251): Launched 15:57:59.403519 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:59.913704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21253): Launched 15:58:00.210032 run osmo-stp_10.42.42.5(pid=21254): Launched 15:58:00.322192 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:00.865948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21256): Launched 15:58:01.211669 run osmo-msc_10.42.42.6(pid=21257): Launched 15:58:01.480755 run osmo-stp_10.42.42.5(pid=21254): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21254)] 15:58:01.646699 run osmo-stp_10.42.42.5(pid=21254): stdout: | (launched: 2022-12-10_15:58:00.155912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:01.994226 run osmo-stp_10.42.42.5(pid=21254): stderr: | [0;m[38;5;43m20221210155800323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155800324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155800324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155800324 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155800326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155800327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155800327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:02.236350 run osmo-stp_10.42.42.5(pid=21254): stdout: | (launched: 2022-12-10_15:58:00.155912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:02.374790 run osmo-stp_10.42.42.5(pid=21254): stderr: | [0;m[38;5;43m20221210155800323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155800324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155800324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155800324 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155800326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155800327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155800327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:02.526717 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21254): Process ended prematurely: osmo-stp_10.42.42.5(pid=21254) [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21254)] [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:58:02.535722 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 15:58:02.564422 run osmo-hlr_10.42.42.2(pid=21251): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21251)] 15:58:02.613919 run osmo-hlr_10.42.42.2(pid=21251): stdout: | (launched: 2022-12-10_15:57:59.236911) 15:58:02.664766 run osmo-hlr_10.42.42.2(pid=21251): stderr: | [0;m[1;31m20221210155759411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155759411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155759411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155759411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155759411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155759411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155759436 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155759445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155759445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155759445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:02.735416 run osmo-msc_10.42.42.6(pid=21257): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21257)] 15:58:02.784630 run osmo-msc_10.42.42.6(pid=21257): stdout: | (launched: 2022-12-10_15:58:01.146843) 15:58:02.835250 run osmo-msc_10.42.42.6(pid=21257): stderr: | [0;m[38;5;43m20221210155801707 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155801707 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca5fd94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155801708 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155801708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155801708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155801708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155801712 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155801715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155801715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155801715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:02.886394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21250): Terminating (SIGTERM) 15:58:02.927427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21253): Terminating (SIGTERM) 15:58:02.968541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21256): Terminating (SIGTERM) 15:58:03.010366 --- ParallelTerminationStrategy: PID 21250 died... 15:58:03.029839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21250): Terminated: ok {rc=0} 15:58:03.076197 --- ParallelTerminationStrategy: PID 21253 died... 15:58:03.095200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21253): Terminated: ok {rc=0} 15:58:03.141389 --- ParallelTerminationStrategy: PID 21256 died... 15:58:03.160421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21256): Terminated: ok {rc=0} 15:58:03.249478 bus /sierra_3: Setting Powered False 15:58:04.349241 bus /sierra_3: Setting Powered False 15:58:05.465990 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 15:58:06.716917 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:58:06.721751 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 15:58:06.755539 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 15:58:06.781540 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 15:58:06.833479 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 15:58:06.866836 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 15:58:06.893078 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 15:58:07.439952 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 15:58:07.487595 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:07.498545 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 15:58:07.547859 tst mo_mt_call.py: using LAC 29042 15:58:07.664597 tst mo_mt_call.py: using RAC 227 15:58:07.780047 tst mo_mt_call.py: using CellId 29042 15:58:07.896665 tst mo_mt_call.py: using BVCI 29043 15:58:08.002986 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:08.013993 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:08.024615 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:08.035546 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:08.046470 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:08.057478 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:58:08.174712 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:58:08.288467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:08.745837 run create_hlr_db(pid=21262): Launched 15:58:08.857866 bus /sierra_2: Setting Powered False 15:58:09.917475 run create_hlr_db(pid=21262): Terminated: ok {rc=0} 15:58:10.350791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21264): Launched 15:58:10.666300 run osmo-hlr_10.42.42.2(pid=21265): Launched 15:58:10.786181 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:11.327697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21267): Launched 15:58:11.642641 run osmo-stp_10.42.42.5(pid=21268): Launched 15:58:11.761869 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:12.330746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21270): Launched 15:58:12.645129 run osmo-msc_10.42.42.6(pid=21271): Launched 15:58:12.820467 run osmo-stp_10.42.42.5(pid=21268): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21268)] 15:58:12.953209 run osmo-stp_10.42.42.5(pid=21268): stdout: | (launched: 2022-12-10_15:58:11.585753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:13.087218 run osmo-stp_10.42.42.5(pid=21268): stderr: | [0;m[38;5;43m20221210155811777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155811777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155811777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155811778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155811778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155811778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155811778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:13.221085 run osmo-stp_10.42.42.5(pid=21268): stdout: | (launched: 2022-12-10_15:58:11.585753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:13.347043 run osmo-stp_10.42.42.5(pid=21268): stderr: | [0;m[38;5;43m20221210155811777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155811777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155811777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155811778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155811778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155811778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155811778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:13.497600 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21268): Process ended prematurely: osmo-stp_10.42.42.5(pid=21268) [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21268)] [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 15:58:13.506896 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 15:58:13.534457 run osmo-hlr_10.42.42.2(pid=21265): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21265)] 15:58:13.584241 run osmo-hlr_10.42.42.2(pid=21265): stdout: | (launched: 2022-12-10_15:58:10.608893) 15:58:13.635722 run osmo-hlr_10.42.42.2(pid=21265): stderr: | [0;m[1;31m20221210155810806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155810806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155810806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155810807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155810807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155810807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155810819 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155810828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155810828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155810828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:13.707430 run osmo-msc_10.42.42.6(pid=21271): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21271)] 15:58:13.756557 run osmo-msc_10.42.42.6(pid=21271): stdout: | (launched: 2022-12-10_15:58:12.588180) 15:58:13.807627 run osmo-msc_10.42.42.6(pid=21271): stderr: | [0;m[38;5;43m20221210155812909 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155812909 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b35ab8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155812909 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155812909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155812909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155812910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155812911 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155812912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155812912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155812912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:13.858893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21264): Terminating (SIGTERM) 15:58:13.900070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21267): Terminating (SIGTERM) 15:58:13.941547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21270): Terminating (SIGTERM) 15:58:13.983264 --- ParallelTerminationStrategy: PID 21264 died... 15:58:14.002914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21264): Terminated: ok {rc=0} 15:58:14.049400 --- ParallelTerminationStrategy: PID 21267 died... 15:58:14.068900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21267): Terminated: ok {rc=0} 15:58:14.114922 --- ParallelTerminationStrategy: PID 21270 died... 15:58:14.134486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21270): Terminated: ok {rc=0} 15:58:14.222327 bus /sierra_3: Setting Powered False 15:58:15.321417 bus /sierra_3: Setting Powered False 15:58:16.443730 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 15:58:17.608370 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:17.620340 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 15:58:17.672334 tst mo_mt_call_osmux.py: using LAC 29043 15:58:17.800795 tst mo_mt_call_osmux.py: using RAC 228 15:58:17.926389 tst mo_mt_call_osmux.py: using CellId 29043 15:58:18.048202 tst mo_mt_call_osmux.py: using BVCI 29044 15:58:18.164581 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:18.176201 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:18.187517 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:18.198805 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:18.210088 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:18.221863 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:58:18.335690 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:58:18.452813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:18.941819 run create_hlr_db(pid=21273): Launched 15:58:19.070825 bus /sierra_2: Setting Powered False 15:58:20.133653 run create_hlr_db(pid=21273): Terminated: ok {rc=0} 15:58:20.557662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21275): Launched 15:58:20.853124 run osmo-hlr_10.42.42.2(pid=21276): Launched 15:58:20.965065 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:21.473665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21278): Launched 15:58:21.768624 run osmo-stp_10.42.42.5(pid=21279): Launched 15:58:21.881700 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:22.415880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21281): Launched 15:58:22.710124 run osmo-msc_10.42.42.6(pid=21282): Launched 15:58:22.874707 run osmo-stp_10.42.42.5(pid=21279): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21279)] 15:58:22.999772 run osmo-stp_10.42.42.5(pid=21279): stdout: | (launched: 2022-12-10_15:58:21.715106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:23.125233 run osmo-stp_10.42.42.5(pid=21279): stderr: | [0;m[38;5;43m20221210155821884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155821884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155821884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155821885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:23.248699 run osmo-stp_10.42.42.5(pid=21279): stdout: | (launched: 2022-12-10_15:58:21.715106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:23.366648 run osmo-stp_10.42.42.5(pid=21279): stderr: | [0;m[38;5;43m20221210155821884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155821884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155821884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155821885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:23.507464 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21279): Process ended prematurely: osmo-stp_10.42.42.5(pid=21279) [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21279)] [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 15:58:23.516214 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 15:58:23.542682 run osmo-hlr_10.42.42.2(pid=21276): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21276)] 15:58:23.590621 run osmo-hlr_10.42.42.2(pid=21276): stdout: | (launched: 2022-12-10_15:58:20.799131) 15:58:23.640131 run osmo-hlr_10.42.42.2(pid=21276): stderr: | [0;m[1;31m20221210155820973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155820973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155820973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155820973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155820973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155820973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155820984 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155820993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155820993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155820993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:23.708578 run osmo-msc_10.42.42.6(pid=21282): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21282)] 15:58:23.756197 run osmo-msc_10.42.42.6(pid=21282): stdout: | (launched: 2022-12-10_15:58:22.656497) 15:58:23.805296 run osmo-msc_10.42.42.6(pid=21282): stderr: | [0;m[38;5;43m20221210155822924 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155822924 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff0b2bffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155822924 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155822924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155822924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155822924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155822926 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155822927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155822927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155822927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:23.854842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21275): Terminating (SIGTERM) 15:58:23.894440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21278): Terminating (SIGTERM) 15:58:23.933969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21281): Terminating (SIGTERM) 15:58:23.973880 --- ParallelTerminationStrategy: PID 21275 died... 15:58:23.992764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21275): Terminated: ok {rc=0} 15:58:24.037018 --- ParallelTerminationStrategy: PID 21278 died... 15:58:24.055495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21278): Terminated: ok {rc=0} 15:58:24.099482 --- ParallelTerminationStrategy: PID 21281 died... 15:58:24.118080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21281): Terminated: ok {rc=0} 15:58:24.201647 bus /sierra_3: Setting Powered False 15:58:25.299661 bus /sierra_3: Setting Powered False 15:58:26.417579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 15:58:27.676131 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:58:27.682721 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 15:58:27.716675 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 15:58:27.744005 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 15:58:27.796793 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 15:58:27.830707 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 15:58:27.857834 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 15:58:28.412199 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 15:58:28.463616 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:28.475274 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 15:58:28.526996 tst mo_mt_call.py: using LAC 29044 15:58:28.651285 tst mo_mt_call.py: using RAC 229 15:58:28.773456 tst mo_mt_call.py: using CellId 29044 15:58:28.899020 tst mo_mt_call.py: using BVCI 29045 15:58:29.015175 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:29.026876 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:29.038396 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:29.049933 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:29.061464 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:29.072911 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:58:29.185498 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:58:29.299245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:29.758182 run create_hlr_db(pid=21287): Launched 15:58:29.871896 bus /sierra_2: Setting Powered False 15:58:30.935853 run create_hlr_db(pid=21287): Terminated: ok {rc=0} 15:58:31.371948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21289): Launched 15:58:31.692216 run osmo-hlr_10.42.42.2(pid=21290): Launched 15:58:32.014089 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:32.642662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21292): Launched 15:58:32.958386 run osmo-stp_10.42.42.5(pid=21293): Launched 15:58:33.077918 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:33.650095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21295): Launched 15:58:33.965368 run osmo-msc_10.42.42.6(pid=21296): Launched 15:58:34.142028 run osmo-stp_10.42.42.5(pid=21293): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21293)] 15:58:34.275779 run osmo-stp_10.42.42.5(pid=21293): stdout: | (launched: 2022-12-10_15:58:32.901219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:34.410648 run osmo-stp_10.42.42.5(pid=21293): stderr: | [0;m[38;5;43m20221210155833091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155833091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155833091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155833091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155833092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155833092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155833092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:34.543997 run osmo-stp_10.42.42.5(pid=21293): stdout: | (launched: 2022-12-10_15:58:32.901219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:34.670199 run osmo-stp_10.42.42.5(pid=21293): stderr: | [0;m[38;5;43m20221210155833091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155833091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155833091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155833091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155833092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155833092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155833092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:34.821111 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21293): Process ended prematurely: osmo-stp_10.42.42.5(pid=21293) [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21293)] [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 15:58:34.830507 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 15:58:34.857797 run osmo-hlr_10.42.42.2(pid=21290): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21290)] 15:58:34.907227 run osmo-hlr_10.42.42.2(pid=21290): stdout: | (launched: 2022-12-10_15:58:31.619957) 15:58:34.958694 run osmo-hlr_10.42.42.2(pid=21290): stderr: | [0;m[1;31m20221210155831847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155831847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155831847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155831847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155831847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155831847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155831866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155831883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155831883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155831883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:35.030271 run osmo-msc_10.42.42.6(pid=21296): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21296)] 15:58:35.079678 run osmo-msc_10.42.42.6(pid=21296): stdout: | (launched: 2022-12-10_15:58:33.908263) 15:58:35.130697 run osmo-msc_10.42.42.6(pid=21296): stderr: | [0;m[38;5;43m20221210155834229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155834230 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f555262fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155834230 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155834230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155834230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155834230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155834232 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155834232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155834232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155834232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:35.182106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21289): Terminating (SIGTERM) 15:58:35.223602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21292): Terminating (SIGTERM) 15:58:35.265190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21295): Terminating (SIGTERM) 15:58:35.306964 --- ParallelTerminationStrategy: PID 21289 died... 15:58:35.326893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21289): Terminated: ok {rc=0} 15:58:35.372625 --- ParallelTerminationStrategy: PID 21292 died... 15:58:35.391920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21292): Terminated: ok {rc=0} 15:58:35.437421 --- ParallelTerminationStrategy: PID 21295 died... 15:58:35.456693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21295): Terminated: ok {rc=0} 15:58:35.542651 bus /sierra_3: Setting Powered False 15:58:36.639935 bus /sierra_3: Setting Powered False 15:58:37.752550 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 15:58:38.899044 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:38.911442 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 15:58:38.965995 tst mo_mt_call_osmux.py: using LAC 29045 15:58:39.083447 tst mo_mt_call_osmux.py: using RAC 230 15:58:39.200836 tst mo_mt_call_osmux.py: using CellId 29045 15:58:39.320840 tst mo_mt_call_osmux.py: using BVCI 29046 15:58:39.429823 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:39.441108 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:39.452277 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:39.463513 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:39.474850 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:39.486070 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:58:39.603023 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:58:39.725064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:40.213401 run create_hlr_db(pid=21298): Launched 15:58:40.341998 bus /sierra_2: Setting Powered False 15:58:41.404609 run create_hlr_db(pid=21298): Terminated: ok {rc=0} 15:58:41.844575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21300): Launched 15:58:42.159306 run osmo-hlr_10.42.42.2(pid=21301): Launched 15:58:42.279089 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:42.820375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21303): Launched 15:58:43.135697 run osmo-stp_10.42.42.5(pid=21304): Launched 15:58:43.255335 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:43.825401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21306): Launched 15:58:44.141373 run osmo-msc_10.42.42.6(pid=21307): Launched 15:58:44.317270 run osmo-stp_10.42.42.5(pid=21304): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21304)] 15:58:44.450016 run osmo-stp_10.42.42.5(pid=21304): stdout: | (launched: 2022-12-10_15:58:43.078520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:44.583794 run osmo-stp_10.42.42.5(pid=21304): stderr: | [0;m[38;5;43m20221210155843269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155843269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155843269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155843270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155843270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155843270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155843270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:44.716710 run osmo-stp_10.42.42.5(pid=21304): stdout: | (launched: 2022-12-10_15:58:43.078520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:44.842474 run osmo-stp_10.42.42.5(pid=21304): stderr: | [0;m[38;5;43m20221210155843269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155843269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155843269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155843270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155843270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155843270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155843270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:44.992901 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21304): Process ended prematurely: osmo-stp_10.42.42.5(pid=21304) [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21304)] [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 15:58:45.002448 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 15:58:45.029738 run osmo-hlr_10.42.42.2(pid=21301): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21301)] 15:58:45.079151 run osmo-hlr_10.42.42.2(pid=21301): stdout: | (launched: 2022-12-10_15:58:42.102476) 15:58:45.130425 run osmo-hlr_10.42.42.2(pid=21301): stderr: | [0;m[1;31m20221210155842299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155842299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155842299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155842299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155842299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155842299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155842312 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155842322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155842322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155842322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:45.201771 run osmo-msc_10.42.42.6(pid=21307): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21307)] 15:58:45.251654 run osmo-msc_10.42.42.6(pid=21307): stdout: | (launched: 2022-12-10_15:58:44.082820) 15:58:45.302580 run osmo-msc_10.42.42.6(pid=21307): stderr: | [0;m[38;5;43m20221210155844405 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155844405 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9030564c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155844405 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155844405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155844405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155844405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155844407 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155844407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155844408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155844408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:45.354454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21300): Terminating (SIGTERM) 15:58:45.395614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21303): Terminating (SIGTERM) 15:58:45.436816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21306): Terminating (SIGTERM) 15:58:45.478175 --- ParallelTerminationStrategy: PID 21300 died... 15:58:45.497630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21300): Terminated: ok {rc=0} 15:58:45.543156 --- ParallelTerminationStrategy: PID 21303 died... 15:58:45.563840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21303): Terminated: ok {rc=0} 15:58:45.609296 --- ParallelTerminationStrategy: PID 21306 died... 15:58:45.628476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21306): Terminated: ok {rc=0} 15:58:45.714873 bus /sierra_3: Setting Powered False 15:58:46.811087 bus /sierra_3: Setting Powered False 15:58:47.924855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 emergency:trx-b200 --------------------------------------------------------------------- 15:58:49.176884 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:58:49.181270 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 15:58:49.215067 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:58:49.241564 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 15:58:49.324452 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 15:58:49.358162 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:58:49.384901 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 15:58:49.965505 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2376 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 15:58:49.970381 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:49.981107 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 15:58:50.029354 tst emergency_mo_mt_call.py: using LAC 29046 15:58:50.143081 tst emergency_mo_mt_call.py: using RAC 231 15:58:50.261704 tst emergency_mo_mt_call.py: using CellId 29046 15:58:50.376261 tst emergency_mo_mt_call.py: using BVCI 29047 15:58:50.481437 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:50.491959 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:50.502354 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:50.512882 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:50.523640 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:50.534167 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:58:50.647954 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:58:50.758293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:51.207241 run create_hlr_db(pid=21312): Launched 15:58:51.317826 bus /sierra_2: Setting Powered False 15:58:52.376236 run create_hlr_db(pid=21312): Terminated: ok {rc=0} 15:58:52.782169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21314): Launched 15:58:53.071137 run osmo-hlr_10.42.42.2(pid=21315): Launched 15:58:53.181831 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:53.693554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21317): Launched 15:58:53.984530 run osmo-stp_10.42.42.5(pid=21318): Launched 15:58:54.105128 tst emergency_mo_mt_call.py: using MSISDN 7786 15:58:54.267581 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:54.788475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21320): Launched 15:58:55.076547 run osmo-msc_10.42.42.6(pid=21321): Launched 15:58:55.238641 run osmo-stp_10.42.42.5(pid=21318): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21318)] 15:58:55.362157 run osmo-stp_10.42.42.5(pid=21318): stdout: | (launched: 2022-12-10_15:58:53.931745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:55.487259 run osmo-stp_10.42.42.5(pid=21318): stderr: | [0;m[38;5;43m20221210155854099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155854099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155854099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155854100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155854100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155854100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155854101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:55.608561 run osmo-stp_10.42.42.5(pid=21318): stdout: | (launched: 2022-12-10_15:58:53.931745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:55.724591 run osmo-stp_10.42.42.5(pid=21318): stderr: | [0;m[38;5;43m20221210155854099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155854099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155854099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155854100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155854100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155854100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155854101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:55.863062 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21318): Process ended prematurely: osmo-stp_10.42.42.5(pid=21318) [trial-2376↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21318)] [trial-2376↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 15:58:55.871384 tst emergency_mo_mt_call.py:19: Test FAILED (5.9 sec) 15:58:55.897647 run osmo-hlr_10.42.42.2(pid=21315): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21315)] 15:58:55.945300 run osmo-hlr_10.42.42.2(pid=21315): stdout: | (launched: 2022-12-10_15:58:53.018306) 15:58:55.994625 run osmo-hlr_10.42.42.2(pid=21315): stderr: | [0;m[1;31m20221210155853191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155853191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155853191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155853191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155853191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155853191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155853204 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155853212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155853212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155853212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:56.063265 run osmo-msc_10.42.42.6(pid=21321): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21321)] 15:58:56.110760 run osmo-msc_10.42.42.6(pid=21321): stdout: | (launched: 2022-12-10_15:58:55.023933) 15:58:56.159786 run osmo-msc_10.42.42.6(pid=21321): stderr: | [0;m[38;5;43m20221210155855294 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155855294 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb53de30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155855294 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155855294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155855294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155855294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155855297 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155855297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155855297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155855297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:56.209305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21314): Terminating (SIGTERM) 15:58:56.248782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21317): Terminating (SIGTERM) 15:58:56.288482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21320): Terminating (SIGTERM) 15:58:56.328183 --- ParallelTerminationStrategy: PID 21314 died... 15:58:56.347259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21314): Terminated: ok {rc=0} 15:58:56.391604 --- ParallelTerminationStrategy: PID 21317 died... 15:58:56.409996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21317): Terminated: ok {rc=0} 15:58:56.454174 --- ParallelTerminationStrategy: PID 21320 died... 15:58:56.472619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21320): Terminated: ok {rc=0} 15:58:56.559242 bus /sierra_3: Setting Powered False 15:58:57.659934 bus /sierra_3: Setting Powered False 15:58:58.776145 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 15:58:59.863683 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:59.875522 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 15:58:59.928689 tst emergency_preemptive_call.py: using LAC 29047 15:59:00.050297 tst emergency_preemptive_call.py: using RAC 232 15:59:00.172422 tst emergency_preemptive_call.py: using CellId 29047 15:59:00.288159 tst emergency_preemptive_call.py: using BVCI 29048 15:59:00.402246 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:59:00.413558 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:59:00.424562 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:59:00.435675 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:59:00.446873 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:59:00.457999 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:59:00.569932 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:59:00.682727 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:59:00.793906 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:59:00.925951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:01.433996 run create_hlr_db(pid=21324): Launched 15:59:01.594862 bus /sierra_2: Setting Powered False 15:59:02.657189 run create_hlr_db(pid=21324): Terminated: ok {rc=0} 15:59:03.073374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21326): Launched 15:59:03.362694 run osmo-hlr_10.42.42.2(pid=21327): Launched 15:59:03.472641 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:03.969914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21329): Launched 15:59:04.259698 run osmo-stp_10.42.42.5(pid=21330): Launched 15:59:04.379384 tst emergency_preemptive_call.py: using MSISDN 7787 15:59:04.540904 run osmo-msc_10.42.42.6: Starting osmo-msc 15:59:05.061775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21332): Launched 15:59:05.352080 run osmo-msc_10.42.42.6(pid=21333): Launched 15:59:05.514326 run osmo-stp_10.42.42.5(pid=21330): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21330)] 15:59:05.638573 run osmo-stp_10.42.42.5(pid=21330): stdout: | (launched: 2022-12-10_15:59:04.206669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:05.762260 run osmo-stp_10.42.42.5(pid=21330): stderr: | [0;m[38;5;43m20221210155904377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155904378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155904378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155904378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155904379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155904379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155904379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:05.883683 run osmo-stp_10.42.42.5(pid=21330): stdout: | (launched: 2022-12-10_15:59:04.206669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:05.999787 run osmo-stp_10.42.42.5(pid=21330): stderr: | [0;m[38;5;43m20221210155904377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155904378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155904378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155904378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155904379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155904379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155904379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:06.138665 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21330): Process ended prematurely: osmo-stp_10.42.42.5(pid=21330) [trial-2376↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21330)] [trial-2376↪emergency:trx-b200↪emergency_preemptive_call.py:32] 15:59:06.146877 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 15:59:06.173730 run osmo-hlr_10.42.42.2(pid=21327): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21327)] 15:59:06.223058 run osmo-hlr_10.42.42.2(pid=21327): stdout: | (launched: 2022-12-10_15:59:03.309940) 15:59:06.272862 run osmo-hlr_10.42.42.2(pid=21327): stderr: | [0;m[1;31m20221210155903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155903493 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155903501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155903501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155903502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:06.342192 run osmo-msc_10.42.42.6(pid=21333): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21333)] 15:59:06.390116 run osmo-msc_10.42.42.6(pid=21333): stdout: | (launched: 2022-12-10_15:59:05.298647) 15:59:06.439474 run osmo-msc_10.42.42.6(pid=21333): stderr: | [0;m[38;5;43m20221210155905566 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210155905566 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9da2768c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210155905566 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210155905566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210155905566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210155905567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210155905568 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210155905569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210155905569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210155905569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:59:06.489375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21326): Terminating (SIGTERM) 15:59:06.529387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21329): Terminating (SIGTERM) 15:59:06.569363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21332): Terminating (SIGTERM) 15:59:06.609761 --- ParallelTerminationStrategy: PID 21326 died... 15:59:06.628733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21326): Terminated: ok {rc=0} 15:59:06.673317 --- ParallelTerminationStrategy: PID 21329 died... 15:59:06.691857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21329): Terminated: ok {rc=0} 15:59:06.736347 --- ParallelTerminationStrategy: PID 21332 died... 15:59:06.754876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21332): Terminated: ok {rc=0} 15:59:06.839194 bus /sierra_9: Setting Powered False 15:59:07.936486 bus /sierra_9: Setting Powered False 15:59:09.052699 bus /sierra_8: Setting Powered False 15:59:10.151315 bus /sierra_8: Setting Powered False 15:59:11.268110 bus /sierra_3: Setting Powered False 15:59:12.367105 bus /sierra_3: Setting Powered False 15:59:13.483335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-b200 --------------------------------------------------------------------- 15:59:14.765699 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:59:14.770326 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 15:59:14.803795 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 15:59:14.843347 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 15:59:14.931569 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 15:59:14.964930 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 15:59:15.003555 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 15:59:15.595458 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 15:59:15.646852 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:15.657935 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:59:15.709358 tst cs_paging_gprs_active.py: using LAC 29048 15:59:15.840141 tst cs_paging_gprs_active.py: using RAC 233 15:59:15.977574 tst cs_paging_gprs_active.py: using CellId 29048 15:59:16.108360 tst cs_paging_gprs_active.py: using BVCI 29049 15:59:16.220512 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:16.232209 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:16.243799 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:16.256161 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:16.270868 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:16.283312 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:16.294864 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:16.307535 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:16.319816 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:16.461109 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:16.608027 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:59:16.830689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:17.228160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21339): Launched 15:59:17.492031 run iperf3-srv_10.42.42.10(pid=21340): Launched 15:59:17.603677 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:59:17.802685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:18.099948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21341): Launched 15:59:18.358424 run iperf3-srv_10.42.42.10(pid=21342): Launched 15:59:18.469336 tst cs_paging_gprs_active.py:38: start network... 15:59:18.668339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:19.126265 run create_hlr_db(pid=21343): Launched 15:59:19.238365 bus /sierra_2: Setting Powered False 15:59:20.298380 run create_hlr_db(pid=21343): Terminated: ok {rc=0} 15:59:20.734124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21345): Launched 15:59:21.050282 run osmo-hlr_10.42.42.2(pid=21346): Launched 15:59:21.171106 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:21.721299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21348): Launched 15:59:22.037335 run osmo-stp_10.42.42.5(pid=21349): Launched 15:59:22.158349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:59:22.706527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21351): Launched 15:59:22.827643 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:59:23.095329 run patchelf(pid=21352): Launched 15:59:23.272289 run osmo-stp_10.42.42.5(pid=21349): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21349)] 15:59:23.407502 run osmo-stp_10.42.42.5(pid=21349): stdout: | (launched: 2022-12-10_15:59:21.979979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:23.544418 run osmo-stp_10.42.42.5(pid=21349): stderr: | [0;m[38;5;43m20221210155922169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155922169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155922169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155922170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155922170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155922170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155922170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:23.681751 run osmo-stp_10.42.42.5(pid=21349): stdout: | (launched: 2022-12-10_15:59:21.979979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:23.812253 run osmo-stp_10.42.42.5(pid=21349): stderr: | [0;m[38;5;43m20221210155922169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155922169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155922169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155922170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155922170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155922170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155922170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:23.967177 run patchelf(pid=21352): Terminating (SIGINT) 15:59:24.145938 run patchelf(pid=21352): Terminated: ok {rc=0} 15:59:24.275028 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21349): Process ended prematurely: osmo-stp_10.42.42.5(pid=21349) [trial-2376↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21349)] [trial-2376↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 15:59:24.285069 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 15:59:24.313493 run osmo-hlr_10.42.42.2(pid=21346): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21346)] 15:59:24.363326 run osmo-hlr_10.42.42.2(pid=21346): stdout: | (launched: 2022-12-10_15:59:20.993167) 15:59:24.414592 run osmo-hlr_10.42.42.2(pid=21346): stderr: | [0;m[1;31m20221210155921190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155921190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155921190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155921190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155921190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155921190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155921202 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155921210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155921210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155921210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:24.466452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21339): Terminating (SIGTERM) 15:59:24.507884 run iperf3-srv_10.42.42.10(pid=21340): Terminating (SIGTERM) 15:59:24.549464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21341): Terminating (SIGTERM) 15:59:24.590928 run iperf3-srv_10.42.42.10(pid=21342): Terminating (SIGTERM) 15:59:24.632369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21345): Terminating (SIGTERM) 15:59:24.674047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21348): Terminating (SIGTERM) 15:59:24.715803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21351): Terminating (SIGTERM) 15:59:24.757879 --- ParallelTerminationStrategy: PID 21339 died... 15:59:24.777824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21339): Terminated: ok {rc=0} 15:59:24.824344 --- ParallelTerminationStrategy: PID 21340 died... 15:59:24.843796 run iperf3-srv_10.42.42.10(pid=21340): Terminated {rc=256} 15:59:24.889321 --- ParallelTerminationStrategy: PID 21341 died... 15:59:24.908494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21341): Terminated: ok {rc=0} 15:59:24.953982 --- ParallelTerminationStrategy: PID 21342 died... 15:59:24.973337 run iperf3-srv_10.42.42.10(pid=21342): Terminated {rc=256} 15:59:25.018833 --- ParallelTerminationStrategy: PID 21345 died... 15:59:25.038255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21345): Terminated: ok {rc=0} 15:59:25.083826 --- ParallelTerminationStrategy: PID 21348 died... 15:59:25.103197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21348): Terminated: ok {rc=0} 15:59:25.149188 --- ParallelTerminationStrategy: PID 21351 died... 15:59:25.168633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21351): Terminated: ok {rc=0} 15:59:25.256850 bus /gobi_0: Setting Powered False 15:59:26.356032 bus /gobi_0: Setting Powered False 15:59:27.472509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200 iperf3.py ---------------------------------------------- 15:59:28.620385 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:28.631851 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:59:28.684461 tst iperf3.py: using LAC 29049 15:59:28.808784 tst iperf3.py: using RAC 234 15:59:28.932720 tst iperf3.py: using CellId 29049 15:59:29.051361 tst iperf3.py: using BVCI 29050 15:59:29.158649 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:29.169454 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:29.179936 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:29.190757 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:29.201263 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:29.211695 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:29.222467 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:29.232926 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:29.243611 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:29.361461 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:59:29.575665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:29.893546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21353): Launched 15:59:30.169195 run iperf3-srv_10.42.42.10(pid=21354): Launched 15:59:30.287955 tst iperf3.py:8: start network... 15:59:30.501793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:31.020655 run create_hlr_db(pid=21355): Launched 15:59:31.170750 bus /gobi_6: Setting Powered False 15:59:32.231822 run create_hlr_db(pid=21355): Terminated: ok {rc=0} 15:59:32.655579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21357): Launched 15:59:32.950509 run osmo-hlr_10.42.42.2(pid=21358): Launched 15:59:33.062786 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:33.570446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21360): Launched 15:59:33.866356 run osmo-stp_10.42.42.5(pid=21361): Launched 15:59:33.978618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:59:34.487662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21363): Launched 15:59:34.600555 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:59:34.850010 run patchelf(pid=21364): Launched 15:59:35.014118 run osmo-stp_10.42.42.5(pid=21361): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21361)] 15:59:35.139803 run osmo-stp_10.42.42.5(pid=21361): stdout: | (launched: 2022-12-10_15:59:33.812732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:35.267060 run osmo-stp_10.42.42.5(pid=21361): stderr: | [0;m[38;5;43m20221210155933981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155933981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155933981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155933981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155933982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155933982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155933982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:35.394262 run osmo-stp_10.42.42.5(pid=21361): stdout: | (launched: 2022-12-10_15:59:33.812732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:35.515386 run osmo-stp_10.42.42.5(pid=21361): stderr: | [0;m[38;5;43m20221210155933981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155933981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155933981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155933981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155933982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155933982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155933982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:35.659004 run patchelf(pid=21364): Terminating (SIGINT) 15:59:35.825630 run patchelf(pid=21364): Terminated: ok {rc=0} 15:59:35.945494 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21361): Process ended prematurely: osmo-stp_10.42.42.5(pid=21361) [trial-2376↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21361)] [trial-2376↪gprs:trx-b200↪iperf3.py:8] 15:59:35.954968 tst iperf3.py:8: Test FAILED (7.4 sec) 15:59:35.982206 run osmo-hlr_10.42.42.2(pid=21358): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21358)] 15:59:36.029992 run osmo-hlr_10.42.42.2(pid=21358): stdout: | (launched: 2022-12-10_15:59:32.896837) 15:59:36.079230 run osmo-hlr_10.42.42.2(pid=21358): stderr: | [0;m[1;31m20221210155933073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155933073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155933073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155933073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155933073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155933073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155933085 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155933093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155933094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155933094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:36.128919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21353): Terminating (SIGTERM) 15:59:36.169117 run iperf3-srv_10.42.42.10(pid=21354): Terminating (SIGTERM) 15:59:36.209023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21357): Terminating (SIGTERM) 15:59:36.248834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21360): Terminating (SIGTERM) 15:59:36.288712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21363): Terminating (SIGTERM) 15:59:36.328894 --- ParallelTerminationStrategy: PID 21353 died... 15:59:36.348108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21353): Terminated: ok {rc=0} 15:59:36.393007 --- ParallelTerminationStrategy: PID 21354 died... 15:59:36.411494 run iperf3-srv_10.42.42.10(pid=21354): Terminated {rc=256} 15:59:36.456095 --- ParallelTerminationStrategy: PID 21357 died... 15:59:36.474730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21357): Terminated: ok {rc=0} 15:59:36.518832 --- ParallelTerminationStrategy: PID 21360 died... 15:59:36.537424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21360): Terminated: ok {rc=0} 15:59:36.581340 --- ParallelTerminationStrategy: PID 21363 died... 15:59:36.599933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21363): Terminated: ok {rc=0} 15:59:36.683413 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 15:59:37.831531 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:37.843224 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:59:37.897407 tst iperf3m4.py: using LAC 29050 15:59:38.022373 tst iperf3m4.py: using RAC 235 15:59:38.144893 tst iperf3m4.py: using CellId 29050 15:59:38.267918 tst iperf3m4.py: using BVCI 29051 15:59:38.382944 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:38.394146 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:38.405156 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:38.415983 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:38.426783 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:38.437595 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:38.448490 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:38.459360 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:38.470317 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:38.587635 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:38.705589 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:38.823838 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:38.940467 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:59:39.140718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:39.438737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21365): Launched 15:59:39.696810 run iperf3-srv_10.42.42.10(pid=21366): Launched 15:59:39.808403 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:59:40.007590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:40.304129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21367): Launched 15:59:40.561993 run iperf3-srv_10.42.42.10(pid=21368): Launched 15:59:40.671989 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:59:40.871461 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:41.168292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21369): Launched 15:59:41.425248 run iperf3-srv_10.42.42.10(pid=21370): Launched 15:59:41.535954 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:59:41.733562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:42.030550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21371): Launched 15:59:42.287543 run iperf3-srv_10.42.42.10(pid=21372): Launched 15:59:42.398353 tst iperf3m4.py:8: start network... 15:59:42.596562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:43.053170 run create_hlr_db(pid=21373): Launched 15:59:43.167276 bus /gobi_6: Setting Powered False 15:59:44.226462 run create_hlr_db(pid=21373): Terminated: ok {rc=0} 15:59:44.640470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21375): Launched 15:59:44.935433 run osmo-hlr_10.42.42.2(pid=21376): Launched 15:59:45.048127 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:45.557427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21378): Launched 15:59:45.857557 run osmo-stp_10.42.42.5(pid=21379): Launched 15:59:46.098988 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:59:46.663986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21381): Launched 15:59:46.792113 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:59:47.054638 run patchelf(pid=21382): Launched 15:59:47.233438 run osmo-stp_10.42.42.5(pid=21379): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21379)] 15:59:47.362360 run osmo-stp_10.42.42.5(pid=21379): stdout: | (launched: 2022-12-10_15:59:45.799607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:47.490962 run osmo-stp_10.42.42.5(pid=21379): stderr: | [0;m[38;5;43m20221210155946026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155946026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155946027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155946027 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155946027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155946028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155946028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:47.619578 run osmo-stp_10.42.42.5(pid=21379): stdout: | (launched: 2022-12-10_15:59:45.799607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:47.741846 run osmo-stp_10.42.42.5(pid=21379): stderr: | [0;m[38;5;43m20221210155946026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210155946026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210155946027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210155946027 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210155946027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210155946028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210155946028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:47.887741 run patchelf(pid=21382): Terminating (SIGINT) 15:59:48.055404 run patchelf(pid=21382): Terminated: ok {rc=0} 15:59:48.176455 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21379): Process ended prematurely: osmo-stp_10.42.42.5(pid=21379) [trial-2376↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21379)] [trial-2376↪gprs:trx-b200↪iperf3m4.py:8] 15:59:48.186202 tst iperf3m4.py:8: Test FAILED (10.4 sec) 15:59:48.214639 run osmo-hlr_10.42.42.2(pid=21376): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21376)] 15:59:48.263075 run osmo-hlr_10.42.42.2(pid=21376): stdout: | (launched: 2022-12-10_15:59:44.881777) 15:59:48.313219 run osmo-hlr_10.42.42.2(pid=21376): stderr: | [0;m[1;31m20221210155945051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210155945051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210155945051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210155945051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210155945051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210155945051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210155945070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210155945079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210155945080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210155945080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:48.363538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21365): Terminating (SIGTERM) 15:59:48.404004 run iperf3-srv_10.42.42.10(pid=21366): Terminating (SIGTERM) 15:59:48.444729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21367): Terminating (SIGTERM) 15:59:48.485387 run iperf3-srv_10.42.42.10(pid=21368): Terminating (SIGTERM) 15:59:48.526034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21369): Terminating (SIGTERM) 15:59:48.566693 run iperf3-srv_10.42.42.10(pid=21370): Terminating (SIGTERM) 15:59:48.607110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21371): Terminating (SIGTERM) 15:59:48.647728 run iperf3-srv_10.42.42.10(pid=21372): Terminating (SIGTERM) 15:59:48.688190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21375): Terminating (SIGTERM) 15:59:48.728843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21378): Terminating (SIGTERM) 15:59:48.769445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21381): Terminating (SIGTERM) 15:59:48.810400 --- ParallelTerminationStrategy: PID 21365 died... 15:59:48.829812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21365): Terminated: ok {rc=0} 15:59:48.875207 --- ParallelTerminationStrategy: PID 21366 died... 15:59:48.894153 run iperf3-srv_10.42.42.10(pid=21366): Terminated {rc=256} 15:59:48.939198 --- ParallelTerminationStrategy: PID 21367 died... 15:59:48.958104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21367): Terminated: ok {rc=0} 15:59:49.003303 --- ParallelTerminationStrategy: PID 21368 died... 15:59:49.022292 run iperf3-srv_10.42.42.10(pid=21368): Terminated {rc=256} 15:59:49.067737 --- ParallelTerminationStrategy: PID 21369 died... 15:59:49.086630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21369): Terminated: ok {rc=0} 15:59:49.131775 --- ParallelTerminationStrategy: PID 21370 died... 15:59:49.150584 run iperf3-srv_10.42.42.10(pid=21370): Terminated {rc=256} 15:59:49.195679 --- ParallelTerminationStrategy: PID 21371 died... 15:59:49.214611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21371): Terminated: ok {rc=0} 15:59:49.260228 --- ParallelTerminationStrategy: PID 21372 died... 15:59:49.279257 run iperf3-srv_10.42.42.10(pid=21372): Terminated {rc=256} 15:59:49.324407 --- ParallelTerminationStrategy: PID 21375 died... 15:59:49.343503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21375): Terminated: ok {rc=0} 15:59:49.389180 --- ParallelTerminationStrategy: PID 21378 died... 15:59:49.408196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21378): Terminated: ok {rc=0} 15:59:49.453432 --- ParallelTerminationStrategy: PID 21381 died... 15:59:49.472440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21381): Terminated: ok {rc=0} 15:59:49.559612 bus /gobi_4: Setting Powered False 15:59:50.659921 bus /gobi_4: Setting Powered False 15:59:51.776409 bus /gobi_1: Setting Powered False 15:59:52.876656 bus /gobi_1: Setting Powered False 15:59:53.992469 bus /gobi_0: Setting Powered False 15:59:55.091644 bus /gobi_0: Setting Powered False 15:59:56.206739 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200 ping.py ---------------------------------------------- 15:59:57.309667 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:57.320717 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:59:57.370097 tst ping.py: using LAC 29051 15:59:57.485838 tst ping.py: using RAC 236 15:59:57.601156 tst ping.py: using CellId 29051 15:59:57.718287 tst ping.py: using BVCI 29052 15:59:57.823643 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:57.834221 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:57.844581 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:57.855275 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:57.865864 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:57.876368 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:57.887049 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:57.897999 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:58.009145 tst ping.py:19: start network... 15:59:58.204355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:58.654659 run create_hlr_db(pid=21383): Launched 15:59:58.765251 bus /gobi_6: Setting Powered False 15:59:59.827674 run create_hlr_db(pid=21383): Terminated: ok {rc=0} 16:00:00.245358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21385): Launched 16:00:00.536714 run osmo-hlr_10.42.42.2(pid=21386): Launched 16:00:00.647344 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:01.189684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21388): Launched 16:00:01.506373 run osmo-stp_10.42.42.5(pid=21389): Launched 16:00:01.739679 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:02.375874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21395): Launched 16:00:02.532767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:02.810591 run patchelf(pid=21402): Launched 16:00:02.976558 run osmo-stp_10.42.42.5(pid=21389): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21389)] 16:00:03.100148 run osmo-stp_10.42.42.5(pid=21389): stdout: | (launched: 2022-12-10_16:00:01.439629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:03.225364 run osmo-stp_10.42.42.5(pid=21389): stderr: | [0;m[38;5;43m20221210160001708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160001708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160001708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160001709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160001709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160001709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160001709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:03.351271 run osmo-stp_10.42.42.5(pid=21389): stdout: | (launched: 2022-12-10_16:00:01.439629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:03.471017 run osmo-stp_10.42.42.5(pid=21389): stderr: | [0;m[38;5;43m20221210160001708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160001708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160001708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160001709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160001709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160001709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160001709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:03.614486 run patchelf(pid=21402): Terminating (SIGINT) 16:00:03.778450 run patchelf(pid=21402): Terminated: ok {rc=0} 16:00:03.897133 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21389): Process ended prematurely: osmo-stp_10.42.42.5(pid=21389) [trial-2376↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21389)] [trial-2376↪gprs:trx-b200↪ping.py:22] 16:00:03.905893 tst ping.py:22: Test FAILED (6.6 sec) 16:00:03.933392 run osmo-hlr_10.42.42.2(pid=21386): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21386)] 16:00:03.981747 run osmo-hlr_10.42.42.2(pid=21386): stdout: | (launched: 2022-12-10_16:00:00.483469) 16:00:04.031430 run osmo-hlr_10.42.42.2(pid=21386): stderr: | [0;m[1;31m20221210160000658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160000658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160000658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160000658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160000658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160000658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160000670 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160000678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160000679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160000679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:04.081397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21385): Terminating (SIGTERM) 16:00:04.121346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21388): Terminating (SIGTERM) 16:00:04.161363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21395): Terminating (SIGTERM) 16:00:04.201628 --- ParallelTerminationStrategy: PID 21385 died... 16:00:04.220819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21385): Terminated: ok {rc=0} 16:00:04.265859 --- ParallelTerminationStrategy: PID 21388 died... 16:00:04.284720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21388): Terminated: ok {rc=0} 16:00:04.329625 --- ParallelTerminationStrategy: PID 21395 died... 16:00:04.348309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21395): Terminated: ok {rc=0} 16:00:04.434767 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 16:00:05.522767 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:05.534480 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:00:05.585632 tst ping_idle_ping.py: using LAC 29052 16:00:05.702217 tst ping_idle_ping.py: using RAC 237 16:00:05.816337 tst ping_idle_ping.py: using CellId 29052 16:00:05.934804 tst ping_idle_ping.py: using BVCI 29053 16:00:06.042972 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:06.053542 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:06.063997 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:06.074643 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:06.085246 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:06.095791 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:06.106491 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:06.117118 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:00:06.234532 tst ping_idle_ping.py:24: start network... 16:00:06.446856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:06.933789 run create_hlr_db(pid=21403): Launched 16:00:07.062299 bus /gobi_6: Setting Powered False 16:00:08.124498 run create_hlr_db(pid=21403): Terminated: ok {rc=0} 16:00:08.544094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21405): Launched 16:00:08.835561 run osmo-hlr_10.42.42.2(pid=21406): Launched 16:00:08.945969 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:09.448617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21408): Launched 16:00:09.738619 run osmo-stp_10.42.42.5(pid=21409): Launched 16:00:09.849729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:10.353243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21411): Launched 16:00:10.465306 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:10.711483 run patchelf(pid=21412): Launched 16:00:10.873852 run osmo-stp_10.42.42.5(pid=21409): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21409)] 16:00:10.997423 run osmo-stp_10.42.42.5(pid=21409): stdout: | (launched: 2022-12-10_16:00:09.685650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:11.122786 run osmo-stp_10.42.42.5(pid=21409): stderr: | [0;m[38;5;43m20221210160009853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160009853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160009854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160009854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160009854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160009854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160009855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:11.248432 run osmo-stp_10.42.42.5(pid=21409): stdout: | (launched: 2022-12-10_16:00:09.685650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:11.368143 run osmo-stp_10.42.42.5(pid=21409): stderr: | [0;m[38;5;43m20221210160009853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160009853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160009854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160009854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160009854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160009854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160009855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:11.510100 run patchelf(pid=21412): Terminating (SIGINT) 16:00:11.673994 run patchelf(pid=21412): Terminated: ok {rc=0} 16:00:11.791872 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21409): Process ended prematurely: osmo-stp_10.42.42.5(pid=21409) [trial-2376↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21409)] [trial-2376↪gprs:trx-b200↪ping_idle_ping.py:27] 16:00:11.800727 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 16:00:11.827958 run osmo-hlr_10.42.42.2(pid=21406): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21406)] 16:00:11.875945 run osmo-hlr_10.42.42.2(pid=21406): stdout: | (launched: 2022-12-10_16:00:08.782373) 16:00:11.925749 run osmo-hlr_10.42.42.2(pid=21406): stderr: | [0;m[1;31m20221210160008957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160008958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160008958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160008958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160008958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160008958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160008972 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160008980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160008980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160008980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:11.975708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21405): Terminating (SIGTERM) 16:00:12.016152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21408): Terminating (SIGTERM) 16:00:12.056257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21411): Terminating (SIGTERM) 16:00:12.096862 --- ParallelTerminationStrategy: PID 21405 died... 16:00:12.116247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21405): Terminated: ok {rc=0} 16:00:12.161139 --- ParallelTerminationStrategy: PID 21408 died... 16:00:12.179792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21408): Terminated: ok {rc=0} 16:00:12.224314 --- ParallelTerminationStrategy: PID 21411 died... 16:00:12.243048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21411): Terminated: ok {rc=0} 16:00:12.327304 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 16:00:13.639434 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:00:13.645191 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:00:13.679675 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:00:13.719088 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:00:13.809455 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:00:13.846400 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:00:13.885387 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:00:14.474616 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:00:14.524455 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:14.535873 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:00:14.602855 tst cs_paging_gprs_active.py: using LAC 29053 16:00:14.737011 tst cs_paging_gprs_active.py: using RAC 238 16:00:14.855916 tst cs_paging_gprs_active.py: using CellId 29053 16:00:15.001351 tst cs_paging_gprs_active.py: using BVCI 29054 16:00:15.115374 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:15.127292 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:15.139024 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:15.150975 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:15.163208 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:15.176140 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:15.187892 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:15.200006 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:15.212536 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:15.338323 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:15.467476 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:00:15.687717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:16.031514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21769): Launched 16:00:16.334532 run iperf3-srv_10.42.42.10(pid=21770): Launched 16:00:16.463979 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:00:16.684504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:17.014584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21771): Launched 16:00:17.301974 run iperf3-srv_10.42.42.10(pid=21772): Launched 16:00:17.420596 tst cs_paging_gprs_active.py:38: start network... 16:00:17.635433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:18.126794 run create_hlr_db(pid=21773): Launched 16:00:18.255374 bus /gobi_6: Setting Powered False 16:00:19.318918 run create_hlr_db(pid=21773): Terminated: ok {rc=0} 16:00:19.743287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21775): Launched 16:00:20.039167 run osmo-hlr_10.42.42.2(pid=21776): Launched 16:00:20.151148 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:20.659771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21778): Launched 16:00:20.955400 run osmo-stp_10.42.42.5(pid=21779): Launched 16:00:21.067675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:21.578230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21781): Launched 16:00:21.691471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:21.942574 run patchelf(pid=21782): Launched 16:00:22.107791 run osmo-stp_10.42.42.5(pid=21779): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21779)] 16:00:22.233767 run osmo-stp_10.42.42.5(pid=21779): stdout: | (launched: 2022-12-10_16:00:20.901443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:22.361965 run osmo-stp_10.42.42.5(pid=21779): stderr: | [0;m[38;5;43m20221210160021068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160021068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160021068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160021069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160021069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160021069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160021069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:22.489889 run osmo-stp_10.42.42.5(pid=21779): stdout: | (launched: 2022-12-10_16:00:20.901443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:22.611649 run osmo-stp_10.42.42.5(pid=21779): stderr: | [0;m[38;5;43m20221210160021068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160021068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160021068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160021069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160021069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160021069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160021069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:22.755906 run patchelf(pid=21782): Terminating (SIGINT) 16:00:22.923512 run patchelf(pid=21782): Terminated: ok {rc=0} 16:00:23.044559 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21779): Process ended prematurely: osmo-stp_10.42.42.5(pid=21779) [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21779)] [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:00:23.054222 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:00:23.081497 run osmo-hlr_10.42.42.2(pid=21776): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21776)] 16:00:23.129790 run osmo-hlr_10.42.42.2(pid=21776): stdout: | (launched: 2022-12-10_16:00:19.985546) 16:00:23.179639 run osmo-hlr_10.42.42.2(pid=21776): stderr: | [0;m[1;31m20221210160020159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160020159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160020159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160020159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160020159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160020159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160020171 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160020180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160020180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160020180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:23.229509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21769): Terminating (SIGTERM) 16:00:23.269814 run iperf3-srv_10.42.42.10(pid=21770): Terminating (SIGTERM) 16:00:23.310157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21771): Terminating (SIGTERM) 16:00:23.350784 run iperf3-srv_10.42.42.10(pid=21772): Terminating (SIGTERM) 16:00:23.392771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21775): Terminating (SIGTERM) 16:00:23.434148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21778): Terminating (SIGTERM) 16:00:23.475108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21781): Terminating (SIGTERM) 16:00:23.517673 --- ParallelTerminationStrategy: PID 21769 died... 16:00:23.537251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21769): Terminated: ok {rc=0} 16:00:23.583915 --- ParallelTerminationStrategy: PID 21770 died... 16:00:23.603508 run iperf3-srv_10.42.42.10(pid=21770): Terminated {rc=256} 16:00:23.650382 --- ParallelTerminationStrategy: PID 21771 died... 16:00:23.670095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21771): Terminated: ok {rc=0} 16:00:23.716681 --- ParallelTerminationStrategy: PID 21772 died... 16:00:23.736233 run iperf3-srv_10.42.42.10(pid=21772): Terminated {rc=256} 16:00:23.783092 --- ParallelTerminationStrategy: PID 21775 died... 16:00:23.802668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21775): Terminated: ok {rc=0} 16:00:23.849111 --- ParallelTerminationStrategy: PID 21778 died... 16:00:23.868671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21778): Terminated: ok {rc=0} 16:00:23.915241 --- ParallelTerminationStrategy: PID 21781 died... 16:00:23.934777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21781): Terminated: ok {rc=0} 16:00:24.019080 bus /gobi_0: Setting Powered False 16:00:25.117365 bus /gobi_0: Setting Powered False 16:00:26.238801 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:00:27.387305 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:27.399597 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:00:27.454204 tst iperf3.py: using LAC 29054 16:00:27.574537 tst iperf3.py: using RAC 239 16:00:27.693807 tst iperf3.py: using CellId 29054 16:00:27.817681 tst iperf3.py: using BVCI 29055 16:00:27.929527 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:27.941311 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:27.952823 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:27.967695 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:27.980319 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:27.991796 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:28.004666 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:28.018531 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:28.030164 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:28.148351 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:00:28.351945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:28.671106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21958): Launched 16:00:28.960991 run iperf3-srv_10.42.42.10(pid=21959): Launched 16:00:29.117815 tst iperf3.py:8: start network... 16:00:29.329009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:29.800131 run create_hlr_db(pid=21961): Launched 16:00:29.917998 bus /gobi_6: Setting Powered False 16:00:30.978445 run create_hlr_db(pid=21961): Terminated: ok {rc=0} 16:00:31.415051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21963): Launched 16:00:31.733693 run osmo-hlr_10.42.42.2(pid=21964): Launched 16:00:31.979252 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:32.637470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21966): Launched 16:00:32.941692 run osmo-stp_10.42.42.5(pid=21967): Launched 16:00:33.057573 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:33.580313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21969): Launched 16:00:33.698874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:33.955488 run patchelf(pid=21970): Launched 16:00:34.124037 run osmo-stp_10.42.42.5(pid=21967): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21967)] 16:00:34.253682 run osmo-stp_10.42.42.5(pid=21967): stdout: | (launched: 2022-12-10_16:00:32.885600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:34.384453 run osmo-stp_10.42.42.5(pid=21967): stderr: | [0;m[38;5;43m20221210160033057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160033057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160033058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160033058 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160033058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160033059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160033059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:34.515139 run osmo-stp_10.42.42.5(pid=21967): stdout: | (launched: 2022-12-10_16:00:32.885600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:34.639699 run osmo-stp_10.42.42.5(pid=21967): stderr: | [0;m[38;5;43m20221210160033057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160033057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160033058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160033058 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160033058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160033059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160033059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:34.787209 run patchelf(pid=21970): Terminating (SIGINT) 16:00:34.957645 run patchelf(pid=21970): Terminated: ok {rc=0} 16:00:35.080515 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21967): Process ended prematurely: osmo-stp_10.42.42.5(pid=21967) [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21967)] [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 16:00:35.090019 tst iperf3.py:8: Test FAILED (7.7 sec) 16:00:35.117329 run osmo-hlr_10.42.42.2(pid=21964): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21964)] 16:00:35.165734 run osmo-hlr_10.42.42.2(pid=21964): stdout: | (launched: 2022-12-10_16:00:31.674575) 16:00:35.215482 run osmo-hlr_10.42.42.2(pid=21964): stderr: | [0;m[1;31m20221210160032020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160032020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160032020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160032020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160032020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160032020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160032035 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160032052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160032052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160032052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:35.265743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21958): Terminating (SIGTERM) 16:00:35.305733 run iperf3-srv_10.42.42.10(pid=21959): Terminating (SIGTERM) 16:00:35.345590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21963): Terminating (SIGTERM) 16:00:35.385566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21966): Terminating (SIGTERM) 16:00:35.425745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21969): Terminating (SIGTERM) 16:00:35.466155 --- ParallelTerminationStrategy: PID 21958 died... 16:00:35.485383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21958): Terminated: ok {rc=0} 16:00:35.530213 --- ParallelTerminationStrategy: PID 21959 died... 16:00:35.548812 run iperf3-srv_10.42.42.10(pid=21959): Terminated {rc=256} 16:00:35.593983 --- ParallelTerminationStrategy: PID 21963 died... 16:00:35.612731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21963): Terminated: ok {rc=0} 16:00:35.657261 --- ParallelTerminationStrategy: PID 21966 died... 16:00:35.675843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21966): Terminated: ok {rc=0} 16:00:35.720528 --- ParallelTerminationStrategy: PID 21969 died... 16:00:35.739318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21969): Terminated: ok {rc=0} 16:00:35.825288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:00:36.972351 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:36.984042 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:00:37.034859 tst iperf3m4.py: using LAC 29055 16:00:37.156271 tst iperf3m4.py: using RAC 240 16:00:37.285217 tst iperf3m4.py: using CellId 29055 16:00:37.417517 tst iperf3m4.py: using BVCI 29056 16:00:37.536903 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:37.548508 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:37.559832 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:37.571304 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:37.582723 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:37.594024 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:37.605470 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:37.616632 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:37.628030 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:37.749882 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:37.869463 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:37.989733 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:38.109374 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:00:38.330655 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:38.656590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21971): Launched 16:00:38.938497 run iperf3-srv_10.42.42.10(pid=21972): Launched 16:00:39.060939 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:00:39.280812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:39.606852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21973): Launched 16:00:39.889373 run iperf3-srv_10.42.42.10(pid=21974): Launched 16:00:40.010976 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:00:40.230282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:40.555967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21975): Launched 16:00:40.837521 run iperf3-srv_10.42.42.10(pid=21976): Launched 16:00:40.958552 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:00:41.177596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:41.503541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21977): Launched 16:00:41.784577 run iperf3-srv_10.42.42.10(pid=21978): Launched 16:00:41.905938 tst iperf3m4.py:8: start network... 16:00:42.124057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:42.628662 run create_hlr_db(pid=21979): Launched 16:00:42.759767 bus /gobi_6: Setting Powered False 16:00:43.823545 run create_hlr_db(pid=21979): Terminated: ok {rc=0} 16:00:44.257775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21981): Launched 16:00:44.563581 run osmo-hlr_10.42.42.2(pid=21982): Launched 16:00:44.680637 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:45.210598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21984): Launched 16:00:45.514947 run osmo-stp_10.42.42.5(pid=21985): Launched 16:00:45.631213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:46.192500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21987): Launched 16:00:46.331388 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:46.629753 run patchelf(pid=21988): Launched 16:00:46.819354 run osmo-stp_10.42.42.5(pid=21985): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21985)] 16:00:46.959379 run osmo-stp_10.42.42.5(pid=21985): stdout: | (launched: 2022-12-10_16:00:45.459058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:47.102254 run osmo-stp_10.42.42.5(pid=21985): stderr: | [0;m[38;5;43m20221210160045629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160045629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160045629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160045629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160045630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160045630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160045630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:47.241291 run osmo-stp_10.42.42.5(pid=21985): stdout: | (launched: 2022-12-10_16:00:45.459058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:47.367679 run osmo-stp_10.42.42.5(pid=21985): stderr: | [0;m[38;5;43m20221210160045629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160045629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160045629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160045629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160045630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160045630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160045630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:47.516822 run patchelf(pid=21988): Terminating (SIGINT) 16:00:47.689258 run patchelf(pid=21988): Terminated: ok {rc=0} 16:00:47.813453 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21985): Process ended prematurely: osmo-stp_10.42.42.5(pid=21985) [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21985)] [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 16:00:47.823201 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:00:47.851948 run osmo-hlr_10.42.42.2(pid=21982): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21982)] 16:00:47.900701 run osmo-hlr_10.42.42.2(pid=21982): stdout: | (launched: 2022-12-10_16:00:44.507283) 16:00:47.950629 run osmo-hlr_10.42.42.2(pid=21982): stderr: | [0;m[1;31m20221210160044684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160044684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160044684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160044684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160044684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160044684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160044696 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160044705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160044706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160044706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:48.001147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21971): Terminating (SIGTERM) 16:00:48.041791 run iperf3-srv_10.42.42.10(pid=21972): Terminating (SIGTERM) 16:00:48.082184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21973): Terminating (SIGTERM) 16:00:48.122901 run iperf3-srv_10.42.42.10(pid=21974): Terminating (SIGTERM) 16:00:48.163549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21975): Terminating (SIGTERM) 16:00:48.204300 run iperf3-srv_10.42.42.10(pid=21976): Terminating (SIGTERM) 16:00:48.244769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21977): Terminating (SIGTERM) 16:00:48.285564 run iperf3-srv_10.42.42.10(pid=21978): Terminating (SIGTERM) 16:00:48.326322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21981): Terminating (SIGTERM) 16:00:48.367029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21984): Terminating (SIGTERM) 16:00:48.407600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21987): Terminating (SIGTERM) 16:00:48.448766 --- ParallelTerminationStrategy: PID 21971 died... 16:00:48.467733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21971): Terminated: ok {rc=0} 16:00:48.512883 --- ParallelTerminationStrategy: PID 21972 died... 16:00:48.531684 run iperf3-srv_10.42.42.10(pid=21972): Terminated {rc=256} 16:00:48.576689 --- ParallelTerminationStrategy: PID 21973 died... 16:00:48.595601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21973): Terminated: ok {rc=0} 16:00:48.640571 --- ParallelTerminationStrategy: PID 21974 died... 16:00:48.659618 run iperf3-srv_10.42.42.10(pid=21974): Terminated {rc=256} 16:00:48.704331 --- ParallelTerminationStrategy: PID 21975 died... 16:00:48.723355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21975): Terminated: ok {rc=0} 16:00:48.768380 --- ParallelTerminationStrategy: PID 21976 died... 16:00:48.787282 run iperf3-srv_10.42.42.10(pid=21976): Terminated {rc=256} 16:00:48.832190 --- ParallelTerminationStrategy: PID 21977 died... 16:00:48.851085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21977): Terminated: ok {rc=0} 16:00:48.896136 --- ParallelTerminationStrategy: PID 21978 died... 16:00:48.915008 run iperf3-srv_10.42.42.10(pid=21978): Terminated {rc=256} 16:00:48.959993 --- ParallelTerminationStrategy: PID 21981 died... 16:00:48.979044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21981): Terminated: ok {rc=0} 16:00:49.024310 --- ParallelTerminationStrategy: PID 21984 died... 16:00:49.043313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21984): Terminated: ok {rc=0} 16:00:49.088544 --- ParallelTerminationStrategy: PID 21987 died... 16:00:49.107688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21987): Terminated: ok {rc=0} 16:00:49.194385 bus /gobi_4: Setting Powered False 16:00:50.295454 bus /gobi_4: Setting Powered False 16:00:51.411820 bus /gobi_1: Setting Powered False 16:00:52.512108 bus /gobi_1: Setting Powered False 16:00:53.625786 bus /gobi_0: Setting Powered False 16:00:54.721812 bus /gobi_0: Setting Powered False 16:00:55.837955 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 16:00:56.940542 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:56.952652 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:00:57.005695 tst ping.py: using LAC 29056 16:00:57.132532 tst ping.py: using RAC 241 16:00:57.257322 tst ping.py: using CellId 29056 16:00:57.384513 tst ping.py: using BVCI 29057 16:00:57.502043 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:57.513696 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:57.525349 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:57.536775 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:57.548016 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:57.559187 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:57.570716 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:57.582165 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:57.696344 tst ping.py:19: start network... 16:00:57.897112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:58.359483 run create_hlr_db(pid=21989): Launched 16:00:58.474402 bus /gobi_6: Setting Powered False 16:00:59.534550 run create_hlr_db(pid=21989): Terminated: ok {rc=0} 16:00:59.954268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21991): Launched 16:01:00.252697 run osmo-hlr_10.42.42.2(pid=21992): Launched 16:01:00.366744 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:00.907662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21994): Launched 16:01:01.229691 run osmo-stp_10.42.42.5(pid=21995): Launched 16:01:01.495573 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:02.183151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21997): Launched 16:01:02.316782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:02.587383 run patchelf(pid=21998): Launched 16:01:02.764489 run osmo-stp_10.42.42.5(pid=21995): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21995)] 16:01:02.899597 run osmo-stp_10.42.42.5(pid=21995): stdout: | (launched: 2022-12-10_16:01:01.161703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:03.036084 run osmo-stp_10.42.42.5(pid=21995): stderr: | [0;m[38;5;43m20221210160101412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160101412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160101412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160101413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160101413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160101413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160101413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:03.172686 run osmo-stp_10.42.42.5(pid=21995): stdout: | (launched: 2022-12-10_16:01:01.161703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:03.303782 run osmo-stp_10.42.42.5(pid=21995): stderr: | [0;m[38;5;43m20221210160101412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160101412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160101412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160101413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160101413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160101413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160101413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:03.459059 run patchelf(pid=21998): Terminating (SIGINT) 16:01:03.637474 run patchelf(pid=21998): Terminated: ok {rc=0} 16:01:03.766328 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21995): Process ended prematurely: osmo-stp_10.42.42.5(pid=21995) [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21995)] [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 16:01:03.776212 tst ping.py:22: Test FAILED (6.8 sec) 16:01:03.804588 run osmo-hlr_10.42.42.2(pid=21992): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21992)] 16:01:03.855108 run osmo-hlr_10.42.42.2(pid=21992): stdout: | (launched: 2022-12-10_16:01:00.197670) 16:01:03.907507 run osmo-hlr_10.42.42.2(pid=21992): stderr: | [0;m[1;31m20221210160100375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160100375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160100376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160100376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160100376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160100376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160100399 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160100408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160100409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160100409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:03.960228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21991): Terminating (SIGTERM) 16:01:04.002669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21994): Terminating (SIGTERM) 16:01:04.046304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21997): Terminating (SIGTERM) 16:01:04.089596 --- ParallelTerminationStrategy: PID 21991 died... 16:01:04.109898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21991): Terminated: ok {rc=0} 16:01:04.157353 --- ParallelTerminationStrategy: PID 21994 died... 16:01:04.177242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21994): Terminated: ok {rc=0} 16:01:04.223726 --- ParallelTerminationStrategy: PID 21997 died... 16:01:04.243537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21997): Terminated: ok {rc=0} 16:01:04.332525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:01:05.421546 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:05.433869 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:01:05.486947 tst ping_idle_ping.py: using LAC 29057 16:01:05.613512 tst ping_idle_ping.py: using RAC 242 16:01:05.732180 tst ping_idle_ping.py: using CellId 29057 16:01:05.851237 tst ping_idle_ping.py: using BVCI 29058 16:01:05.961700 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:05.972527 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:05.983168 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:05.994666 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:06.006065 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:06.017277 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:06.028645 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:06.039960 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:01:06.157826 tst ping_idle_ping.py:24: start network... 16:01:06.374840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:06.872585 run create_hlr_db(pid=21999): Launched 16:01:07.002809 bus /gobi_6: Setting Powered False 16:01:08.066239 run create_hlr_db(pid=21999): Terminated: ok {rc=0} 16:01:08.496536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22001): Launched 16:01:08.797638 run osmo-hlr_10.42.42.2(pid=22002): Launched 16:01:08.911719 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:09.428735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22004): Launched 16:01:09.728896 run osmo-stp_10.42.42.5(pid=22005): Launched 16:01:09.843357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:10.362688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22007): Launched 16:01:10.477973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:10.732029 run patchelf(pid=22008): Launched 16:01:10.898534 run osmo-stp_10.42.42.5(pid=22005): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22005)] 16:01:11.025773 run osmo-stp_10.42.42.5(pid=22005): stdout: | (launched: 2022-12-10_16:01:09.673344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:11.154413 run osmo-stp_10.42.42.5(pid=22005): stderr: | [0;m[38;5;43m20221210160109844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160109844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160109844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160109845 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160109845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160109845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160109846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:11.283419 run osmo-stp_10.42.42.5(pid=22005): stdout: | (launched: 2022-12-10_16:01:09.673344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:11.406381 run osmo-stp_10.42.42.5(pid=22005): stderr: | [0;m[38;5;43m20221210160109844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160109844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160109844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160109845 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160109845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160109845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160109846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:11.552290 run patchelf(pid=22008): Terminating (SIGINT) 16:01:11.720721 run patchelf(pid=22008): Terminated: ok {rc=0} 16:01:11.842434 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22005): Process ended prematurely: osmo-stp_10.42.42.5(pid=22005) [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22005)] [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 16:01:11.851204 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:01:11.878723 run osmo-hlr_10.42.42.2(pid=22002): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22002)] 16:01:11.926942 run osmo-hlr_10.42.42.2(pid=22002): stdout: | (launched: 2022-12-10_16:01:08.742412) 16:01:11.976870 run osmo-hlr_10.42.42.2(pid=22002): stderr: | [0;m[1;31m20221210160108915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160108916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160108916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160108916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160108916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160108916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160108932 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160108942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160108943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160108943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:12.027255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22001): Terminating (SIGTERM) 16:01:12.067628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22004): Terminating (SIGTERM) 16:01:12.108051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22007): Terminating (SIGTERM) 16:01:12.148575 --- ParallelTerminationStrategy: PID 22001 died... 16:01:12.168008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22001): Terminated: ok {rc=0} 16:01:12.212880 --- ParallelTerminationStrategy: PID 22004 died... 16:01:12.231683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22004): Terminated: ok {rc=0} 16:01:12.276381 --- ParallelTerminationStrategy: PID 22007 died... 16:01:12.295182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22007): Terminated: ok {rc=0} 16:01:12.379377 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:01:13.699038 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:01:13.706067 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:01:13.741843 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:01:13.782077 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:01:13.870782 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:01:13.904005 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:01:13.942426 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:01:14.542628 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:01:14.597011 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:14.608334 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:01:14.678194 tst cs_paging_gprs_active.py: using LAC 29058 16:01:14.806656 tst cs_paging_gprs_active.py: using RAC 243 16:01:14.932058 tst cs_paging_gprs_active.py: using CellId 29058 16:01:15.058823 tst cs_paging_gprs_active.py: using BVCI 29059 16:01:15.176269 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:15.187702 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:15.198863 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:15.210239 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:15.221294 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:15.232464 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:15.243737 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:15.254812 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:15.266098 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:15.380545 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:15.499330 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:01:15.720026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:16.056688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22012): Launched 16:01:16.417890 run iperf3-srv_10.42.42.10(pid=22013): Launched 16:01:16.564347 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:01:16.787438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:17.122333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22014): Launched 16:01:17.417067 run iperf3-srv_10.42.42.10(pid=22015): Launched 16:01:17.538346 tst cs_paging_gprs_active.py:38: start network... 16:01:17.758256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:18.258850 run create_hlr_db(pid=22016): Launched 16:01:18.391286 bus /gobi_6: Setting Powered False 16:01:19.455584 run create_hlr_db(pid=22016): Terminated: ok {rc=0} 16:01:19.890400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22018): Launched 16:01:20.194071 run osmo-hlr_10.42.42.2(pid=22019): Launched 16:01:20.309949 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:20.848635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22021): Launched 16:01:21.172888 run osmo-stp_10.42.42.5(pid=22022): Launched 16:01:21.296781 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:21.855246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22024): Launched 16:01:21.978862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:22.252844 run patchelf(pid=22025): Launched 16:01:22.433117 run osmo-stp_10.42.42.5(pid=22022): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22022)] 16:01:22.569701 run osmo-stp_10.42.42.5(pid=22022): stdout: | (launched: 2022-12-10_16:01:21.113381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:22.709261 run osmo-stp_10.42.42.5(pid=22022): stderr: | [0;m[38;5;43m20221210160121304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160121304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160121304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160121305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160121305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160121305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160121305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:22.847753 run osmo-stp_10.42.42.5(pid=22022): stdout: | (launched: 2022-12-10_16:01:21.113381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:22.980077 run osmo-stp_10.42.42.5(pid=22022): stderr: | [0;m[38;5;43m20221210160121304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160121304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160121304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160121305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160121305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160121305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160121305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:23.137685 run patchelf(pid=22025): Terminating (SIGINT) 16:01:23.320019 run patchelf(pid=22025): Terminated: ok {rc=0} 16:01:23.451527 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22022): Process ended prematurely: osmo-stp_10.42.42.5(pid=22022) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22022)] [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:01:23.461540 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:01:23.489720 run osmo-hlr_10.42.42.2(pid=22019): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22019)] 16:01:23.539589 run osmo-hlr_10.42.42.2(pid=22019): stdout: | (launched: 2022-12-10_16:01:20.138599) 16:01:23.591237 run osmo-hlr_10.42.42.2(pid=22019): stderr: | [0;m[1;31m20221210160120316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160120316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160120316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160120316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160120316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160120316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160120329 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160120337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160120338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160120338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:23.643299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22012): Terminating (SIGTERM) 16:01:23.685486 run iperf3-srv_10.42.42.10(pid=22013): Terminating (SIGTERM) 16:01:23.727416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22014): Terminating (SIGTERM) 16:01:23.769402 run iperf3-srv_10.42.42.10(pid=22015): Terminating (SIGTERM) 16:01:23.811160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22018): Terminating (SIGTERM) 16:01:23.853018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22021): Terminating (SIGTERM) 16:01:23.894800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22024): Terminating (SIGTERM) 16:01:23.936839 --- ParallelTerminationStrategy: PID 22012 died... 16:01:23.956831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22012): Terminated: ok {rc=0} 16:01:24.003322 --- ParallelTerminationStrategy: PID 22013 died... 16:01:24.022920 run iperf3-srv_10.42.42.10(pid=22013): Terminated {rc=256} 16:01:24.068743 --- ParallelTerminationStrategy: PID 22014 died... 16:01:24.088457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22014): Terminated: ok {rc=0} 16:01:24.134245 --- ParallelTerminationStrategy: PID 22015 died... 16:01:24.153710 run iperf3-srv_10.42.42.10(pid=22015): Terminated {rc=256} 16:01:24.199500 --- ParallelTerminationStrategy: PID 22018 died... 16:01:24.219030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22018): Terminated: ok {rc=0} 16:01:24.264602 --- ParallelTerminationStrategy: PID 22021 died... 16:01:24.284083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22021): Terminated: ok {rc=0} 16:01:24.330752 --- ParallelTerminationStrategy: PID 22024 died... 16:01:24.350300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22024): Terminated: ok {rc=0} 16:01:24.437788 bus /gobi_0: Setting Powered False 16:01:25.536025 bus /gobi_0: Setting Powered False 16:01:26.652477 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:01:27.799223 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:27.811102 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:01:27.882889 tst iperf3.py: using LAC 29059 16:01:28.003732 tst iperf3.py: using RAC 244 16:01:28.125428 tst iperf3.py: using CellId 29059 16:01:28.245453 tst iperf3.py: using BVCI 29060 16:01:28.357693 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:28.368662 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:28.379392 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:28.390591 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:28.401493 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:28.412470 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:28.423621 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:28.434612 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:28.445870 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:28.561681 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:01:28.766033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:29.070462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22026): Launched 16:01:29.334480 run iperf3-srv_10.42.42.10(pid=22027): Launched 16:01:29.448447 tst iperf3.py:8: start network... 16:01:29.652644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:30.121348 run create_hlr_db(pid=22028): Launched 16:01:30.236465 bus /gobi_6: Setting Powered False 16:01:31.297514 run create_hlr_db(pid=22028): Terminated: ok {rc=0} 16:01:31.737709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22030): Launched 16:01:32.069424 run osmo-hlr_10.42.42.2(pid=22031): Launched 16:01:32.208471 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:32.733782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22033): Launched 16:01:33.037422 run osmo-stp_10.42.42.5(pid=22034): Launched 16:01:33.152233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:33.677362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22036): Launched 16:01:33.794495 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:34.052210 run patchelf(pid=22037): Launched 16:01:34.221211 run osmo-stp_10.42.42.5(pid=22034): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22034)] 16:01:34.350435 run osmo-stp_10.42.42.5(pid=22034): stdout: | (launched: 2022-12-10_16:01:32.981803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:34.481168 run osmo-stp_10.42.42.5(pid=22034): stderr: | [0;m[38;5;43m20221210160133151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160133151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160133151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160133152 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160133154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160133154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160133154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:34.612063 run osmo-stp_10.42.42.5(pid=22034): stdout: | (launched: 2022-12-10_16:01:32.981803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:34.737267 run osmo-stp_10.42.42.5(pid=22034): stderr: | [0;m[38;5;43m20221210160133151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160133151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160133151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160133152 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160133154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160133154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160133154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:34.885865 run patchelf(pid=22037): Terminating (SIGINT) 16:01:35.056848 run patchelf(pid=22037): Terminated: ok {rc=0} 16:01:35.180501 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22034): Process ended prematurely: osmo-stp_10.42.42.5(pid=22034) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22034)] [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 16:01:35.190219 tst iperf3.py:8: Test FAILED (7.4 sec) 16:01:35.218069 run osmo-hlr_10.42.42.2(pid=22031): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22031)] 16:01:35.266878 run osmo-hlr_10.42.42.2(pid=22031): stdout: | (launched: 2022-12-10_16:01:32.005263) 16:01:35.316931 run osmo-hlr_10.42.42.2(pid=22031): stderr: | [0;m[1;31m20221210160132272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160132272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160132272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160132272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160132272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160132272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160132284 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160132292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160132293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160132293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:35.367550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22026): Terminating (SIGTERM) 16:01:35.408031 run iperf3-srv_10.42.42.10(pid=22027): Terminating (SIGTERM) 16:01:35.448413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22030): Terminating (SIGTERM) 16:01:35.488801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22033): Terminating (SIGTERM) 16:01:35.529633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22036): Terminating (SIGTERM) 16:01:35.570628 --- ParallelTerminationStrategy: PID 22026 died... 16:01:35.589927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22026): Terminated: ok {rc=0} 16:01:35.635115 --- ParallelTerminationStrategy: PID 22027 died... 16:01:35.653836 run iperf3-srv_10.42.42.10(pid=22027): Terminated {rc=256} 16:01:35.698919 --- ParallelTerminationStrategy: PID 22030 died... 16:01:35.717780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22030): Terminated: ok {rc=0} 16:01:35.762522 --- ParallelTerminationStrategy: PID 22033 died... 16:01:35.781314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22033): Terminated: ok {rc=0} 16:01:35.825956 --- ParallelTerminationStrategy: PID 22036 died... 16:01:35.844848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22036): Terminated: ok {rc=0} 16:01:35.929286 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:01:37.078723 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:37.090868 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:01:37.163795 tst iperf3m4.py: using LAC 29060 16:01:37.292166 tst iperf3m4.py: using RAC 245 16:01:37.419792 tst iperf3m4.py: using CellId 29060 16:01:37.543807 tst iperf3m4.py: using BVCI 29061 16:01:37.656210 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:37.667337 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:37.678300 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:37.689655 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:37.700705 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:37.711933 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:37.723333 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:37.734641 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:37.745783 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:37.864541 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:37.986561 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:38.103438 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:38.224388 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:01:38.444617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:38.770931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22038): Launched 16:01:39.053658 run iperf3-srv_10.42.42.10(pid=22039): Launched 16:01:39.175142 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:01:39.395207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:39.720488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22040): Launched 16:01:40.003590 run iperf3-srv_10.42.42.10(pid=22041): Launched 16:01:40.125080 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:01:40.344474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:40.670289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22042): Launched 16:01:40.951921 run iperf3-srv_10.42.42.10(pid=22043): Launched 16:01:41.073315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:01:41.292226 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:41.618094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22044): Launched 16:01:41.899788 run iperf3-srv_10.42.42.10(pid=22045): Launched 16:01:42.020835 tst iperf3m4.py:8: start network... 16:01:42.239489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:42.742715 run create_hlr_db(pid=22046): Launched 16:01:42.874223 bus /gobi_6: Setting Powered False 16:01:43.938638 run create_hlr_db(pid=22046): Terminated: ok {rc=0} 16:01:44.389992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22048): Launched 16:01:44.713990 run osmo-hlr_10.42.42.2(pid=22049): Launched 16:01:44.836940 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:45.398513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22051): Launched 16:01:45.722454 run osmo-stp_10.42.42.5(pid=22052): Launched 16:01:45.902964 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:46.566216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22054): Launched 16:01:46.701377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:46.985762 run patchelf(pid=22055): Launched 16:01:47.175074 run osmo-stp_10.42.42.5(pid=22052): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22052)] 16:01:47.313910 run osmo-stp_10.42.42.5(pid=22052): stdout: | (launched: 2022-12-10_16:01:45.663449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:47.453750 run osmo-stp_10.42.42.5(pid=22052): stderr: | [0;m[38;5;43m20221210160145853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160145853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160145854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160145854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160145854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160145855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160145855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:47.593449 run osmo-stp_10.42.42.5(pid=22052): stdout: | (launched: 2022-12-10_16:01:45.663449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:47.726633 run osmo-stp_10.42.42.5(pid=22052): stderr: | [0;m[38;5;43m20221210160145853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160145853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160145854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160145854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160145854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160145855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160145855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:47.884467 run patchelf(pid=22055): Terminating (SIGINT) 16:01:48.067435 run patchelf(pid=22055): Terminated: ok {rc=0} 16:01:48.199629 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22052): Process ended prematurely: osmo-stp_10.42.42.5(pid=22052) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22052)] [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:01:48.209804 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:01:48.239035 run osmo-hlr_10.42.42.2(pid=22049): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22049)] 16:01:48.289702 run osmo-hlr_10.42.42.2(pid=22049): stdout: | (launched: 2022-12-10_16:01:44.654647) 16:01:48.342686 run osmo-hlr_10.42.42.2(pid=22049): stderr: | [0;m[1;31m20221210160144854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160144854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160144854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160144854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160144854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160144855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160144866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160144875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160144875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160144875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:48.395599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22038): Terminating (SIGTERM) 16:01:48.438304 run iperf3-srv_10.42.42.10(pid=22039): Terminating (SIGTERM) 16:01:48.480894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22040): Terminating (SIGTERM) 16:01:48.523542 run iperf3-srv_10.42.42.10(pid=22041): Terminating (SIGTERM) 16:01:48.565947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22042): Terminating (SIGTERM) 16:01:48.608595 run iperf3-srv_10.42.42.10(pid=22043): Terminating (SIGTERM) 16:01:48.650991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22044): Terminating (SIGTERM) 16:01:48.693348 run iperf3-srv_10.42.42.10(pid=22045): Terminating (SIGTERM) 16:01:48.735536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22048): Terminating (SIGTERM) 16:01:48.778187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22051): Terminating (SIGTERM) 16:01:48.820810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22054): Terminating (SIGTERM) 16:01:48.863709 --- ParallelTerminationStrategy: PID 22038 died... 16:01:48.884074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22038): Terminated: ok {rc=0} 16:01:48.931578 --- ParallelTerminationStrategy: PID 22039 died... 16:01:48.951477 run iperf3-srv_10.42.42.10(pid=22039): Terminated {rc=256} 16:01:48.998465 --- ParallelTerminationStrategy: PID 22040 died... 16:01:49.018342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22040): Terminated: ok {rc=0} 16:01:49.065322 --- ParallelTerminationStrategy: PID 22041 died... 16:01:49.085224 run iperf3-srv_10.42.42.10(pid=22041): Terminated {rc=256} 16:01:49.132062 --- ParallelTerminationStrategy: PID 22042 died... 16:01:49.151877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22042): Terminated: ok {rc=0} 16:01:49.198683 --- ParallelTerminationStrategy: PID 22043 died... 16:01:49.218450 run iperf3-srv_10.42.42.10(pid=22043): Terminated {rc=256} 16:01:49.265247 --- ParallelTerminationStrategy: PID 22044 died... 16:01:49.284858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22044): Terminated: ok {rc=0} 16:01:49.332522 --- ParallelTerminationStrategy: PID 22045 died... 16:01:49.352423 run iperf3-srv_10.42.42.10(pid=22045): Terminated {rc=256} 16:01:49.399347 --- ParallelTerminationStrategy: PID 22048 died... 16:01:49.419110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22048): Terminated: ok {rc=0} 16:01:49.465922 --- ParallelTerminationStrategy: PID 22051 died... 16:01:49.485738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22051): Terminated: ok {rc=0} 16:01:49.532481 --- ParallelTerminationStrategy: PID 22054 died... 16:01:49.552422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22054): Terminated: ok {rc=0} 16:01:49.642320 bus /gobi_4: Setting Powered False 16:01:50.742749 bus /gobi_4: Setting Powered False 16:01:51.860425 bus /gobi_1: Setting Powered False 16:01:52.960748 bus /gobi_1: Setting Powered False 16:01:54.077877 bus /gobi_0: Setting Powered False 16:01:55.175170 bus /gobi_0: Setting Powered False 16:01:56.288681 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:01:57.392696 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:57.404873 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:01:57.477128 tst ping.py: using LAC 29061 16:01:57.601149 tst ping.py: using RAC 246 16:01:57.725556 tst ping.py: using CellId 29061 16:01:57.850165 tst ping.py: using BVCI 29062 16:01:57.965542 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:57.977062 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:57.988300 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:57.999689 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:58.010858 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:58.022159 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:58.033507 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:58.044661 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:58.162560 tst ping.py:19: start network... 16:01:58.377536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:58.870774 run create_hlr_db(pid=22056): Launched 16:01:59.001106 bus /gobi_6: Setting Powered False 16:02:00.064431 run create_hlr_db(pid=22056): Terminated: ok {rc=0} 16:02:00.493089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22058): Launched 16:02:00.792618 run osmo-hlr_10.42.42.2(pid=22059): Launched 16:02:00.973067 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:01.653974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22061): Launched 16:02:01.968433 run osmo-stp_10.42.42.5(pid=22062): Launched 16:02:02.246548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:02.785261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22064): Launched 16:02:02.907290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:03.177846 run patchelf(pid=22065): Launched 16:02:03.354865 run osmo-stp_10.42.42.5(pid=22062): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22062)] 16:02:03.489597 run osmo-stp_10.42.42.5(pid=22062): stdout: | (launched: 2022-12-10_16:02:01.906024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:03.626116 run osmo-stp_10.42.42.5(pid=22062): stderr: | [0;m[38;5;43m20221210160202103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160202103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160202103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160202104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160202105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160202105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160202105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:03.768827 run osmo-stp_10.42.42.5(pid=22062): stdout: | (launched: 2022-12-10_16:02:01.906024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:03.899746 run osmo-stp_10.42.42.5(pid=22062): stderr: | [0;m[38;5;43m20221210160202103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160202103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160202103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160202104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160202105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160202105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160202105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:04.054186 run patchelf(pid=22065): Terminating (SIGINT) 16:02:04.232366 run patchelf(pid=22065): Terminated: ok {rc=0} 16:02:04.361672 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22062): Process ended prematurely: osmo-stp_10.42.42.5(pid=22062) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22062)] [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 16:02:04.371003 tst ping.py:22: Test FAILED (7.0 sec) 16:02:04.399059 run osmo-hlr_10.42.42.2(pid=22059): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22059)] 16:02:04.448711 run osmo-hlr_10.42.42.2(pid=22059): stdout: | (launched: 2022-12-10_16:02:00.737295) 16:02:04.500129 run osmo-hlr_10.42.42.2(pid=22059): stderr: | [0;m[1;31m20221210160200976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160200985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160200985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160200985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160200985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160200985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160201000 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160201016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160201016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160201016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:04.551920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22058): Terminating (SIGTERM) 16:02:04.593432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22061): Terminating (SIGTERM) 16:02:04.634895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22064): Terminating (SIGTERM) 16:02:04.676623 --- ParallelTerminationStrategy: PID 22058 died... 16:02:04.696523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22058): Terminated: ok {rc=0} 16:02:04.742595 --- ParallelTerminationStrategy: PID 22061 died... 16:02:04.762016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22061): Terminated: ok {rc=0} 16:02:04.807579 --- ParallelTerminationStrategy: PID 22064 died... 16:02:04.826943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22064): Terminated: ok {rc=0} 16:02:04.913822 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:02:06.002131 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:06.013825 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:02:06.087394 tst ping_idle_ping.py: using LAC 29062 16:02:06.204519 tst ping_idle_ping.py: using RAC 247 16:02:06.328478 tst ping_idle_ping.py: using CellId 29062 16:02:06.444925 tst ping_idle_ping.py: using BVCI 29063 16:02:06.553633 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:06.565099 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:06.575837 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:06.587109 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:06.598110 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:06.609346 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:06.620382 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:06.631563 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:02:06.744522 tst ping_idle_ping.py:24: start network... 16:02:06.946962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:07.417681 run create_hlr_db(pid=22066): Launched 16:02:07.532899 bus /gobi_6: Setting Powered False 16:02:08.592392 run create_hlr_db(pid=22066): Terminated: ok {rc=0} 16:02:09.010621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22068): Launched 16:02:09.309779 run osmo-hlr_10.42.42.2(pid=22069): Launched 16:02:09.424124 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:09.942373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22071): Launched 16:02:10.241669 run osmo-stp_10.42.42.5(pid=22072): Launched 16:02:10.355780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:10.871847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22074): Launched 16:02:10.986641 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:11.239481 run patchelf(pid=22075): Launched 16:02:11.405923 run osmo-stp_10.42.42.5(pid=22072): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22072)] 16:02:11.532119 run osmo-stp_10.42.42.5(pid=22072): stdout: | (launched: 2022-12-10_16:02:10.186474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:11.660286 run osmo-stp_10.42.42.5(pid=22072): stderr: | [0;m[38;5;43m20221210160210357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160210357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160210357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160210358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160210360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160210360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160210360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:11.788280 run osmo-stp_10.42.42.5(pid=22072): stdout: | (launched: 2022-12-10_16:02:10.186474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:11.911164 run osmo-stp_10.42.42.5(pid=22072): stderr: | [0;m[38;5;43m20221210160210357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160210357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160210357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160210358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160210360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160210360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160210360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:12.056056 run patchelf(pid=22075): Terminating (SIGINT) 16:02:12.223154 run patchelf(pid=22075): Terminated: ok {rc=0} 16:02:12.344268 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22072): Process ended prematurely: osmo-stp_10.42.42.5(pid=22072) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22072)] [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:02:12.353253 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 16:02:12.380383 run osmo-hlr_10.42.42.2(pid=22069): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22069)] 16:02:12.428238 run osmo-hlr_10.42.42.2(pid=22069): stdout: | (launched: 2022-12-10_16:02:09.254338) 16:02:12.477830 run osmo-hlr_10.42.42.2(pid=22069): stderr: | [0;m[1;31m20221210160209430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160209430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160209430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160209430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160209430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160209431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160209443 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160209452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160209452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160209452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:12.527879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22068): Terminating (SIGTERM) 16:02:12.567882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22071): Terminating (SIGTERM) 16:02:12.608101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22074): Terminating (SIGTERM) 16:02:12.648207 --- ParallelTerminationStrategy: PID 22068 died... 16:02:12.667181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22068): Terminated: ok {rc=0} 16:02:12.712225 --- ParallelTerminationStrategy: PID 22071 died... 16:02:12.730540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22071): Terminated: ok {rc=0} 16:02:12.774360 --- ParallelTerminationStrategy: PID 22074 died... 16:02:12.792724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22074): Terminated: ok {rc=0} 16:02:12.876375 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:02:14.184009 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:02:14.191248 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:02:14.224787 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:02:14.262901 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:02:14.349534 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:02:14.382395 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:02:14.420344 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:02:15.013552 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:02:15.062652 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:15.073602 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:02:15.142922 tst cs_paging_gprs_active.py: using LAC 29063 16:02:15.263861 tst cs_paging_gprs_active.py: using RAC 248 16:02:15.382968 tst cs_paging_gprs_active.py: using CellId 29063 16:02:15.503993 tst cs_paging_gprs_active.py: using BVCI 29064 16:02:15.616025 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:15.626926 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:15.637703 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:15.648564 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:15.659447 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:15.670394 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:15.681487 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:15.692317 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:15.703373 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:15.821457 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:15.955064 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:02:16.184554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:16.529645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22081): Launched 16:02:16.832261 run iperf3-srv_10.42.42.10(pid=22082): Launched 16:02:16.965487 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:02:17.191177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:17.520145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22083): Launched 16:02:17.803983 run iperf3-srv_10.42.42.10(pid=22084): Launched 16:02:17.925883 tst cs_paging_gprs_active.py:38: start network... 16:02:18.145908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:18.649426 run create_hlr_db(pid=22085): Launched 16:02:18.782070 bus /gobi_6: Setting Powered False 16:02:19.846429 run create_hlr_db(pid=22085): Terminated: ok {rc=0} 16:02:20.279855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22087): Launched 16:02:20.584428 run osmo-hlr_10.42.42.2(pid=22088): Launched 16:02:20.700623 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:21.238936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22090): Launched 16:02:21.542767 run osmo-stp_10.42.42.5(pid=22091): Launched 16:02:21.658754 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:22.197612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22093): Launched 16:02:22.314438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:22.571771 run patchelf(pid=22094): Launched 16:02:22.740799 run osmo-stp_10.42.42.5(pid=22091): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22091)] 16:02:22.869875 run osmo-stp_10.42.42.5(pid=22091): stdout: | (launched: 2022-12-10_16:02:21.486949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:23.000796 run osmo-stp_10.42.42.5(pid=22091): stderr: | [0;m[38;5;43m20221210160221657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160221657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160221657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160221658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160221660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160221660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160221660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:23.132328 run osmo-stp_10.42.42.5(pid=22091): stdout: | (launched: 2022-12-10_16:02:21.486949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:23.256886 run osmo-stp_10.42.42.5(pid=22091): stderr: | [0;m[38;5;43m20221210160221657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160221657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160221657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160221658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160221660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160221660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160221660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:23.405055 run patchelf(pid=22094): Terminating (SIGINT) 16:02:23.576492 run patchelf(pid=22094): Terminated: ok {rc=0} 16:02:23.700098 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22091): Process ended prematurely: osmo-stp_10.42.42.5(pid=22091) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22091)] [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:02:23.709656 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:02:23.737346 run osmo-hlr_10.42.42.2(pid=22088): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22088)] 16:02:23.785602 run osmo-hlr_10.42.42.2(pid=22088): stdout: | (launched: 2022-12-10_16:02:20.528536) 16:02:23.835034 run osmo-hlr_10.42.42.2(pid=22088): stderr: | [0;m[1;31m20221210160220704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160220704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160220705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160220705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160220705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160220705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160220718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160220726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160220726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160220726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:23.884990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22081): Terminating (SIGTERM) 16:02:23.925058 run iperf3-srv_10.42.42.10(pid=22082): Terminating (SIGTERM) 16:02:23.965157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22083): Terminating (SIGTERM) 16:02:24.005806 run iperf3-srv_10.42.42.10(pid=22084): Terminating (SIGTERM) 16:02:24.045914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22087): Terminating (SIGTERM) 16:02:24.086047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22090): Terminating (SIGTERM) 16:02:24.126219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22093): Terminating (SIGTERM) 16:02:24.166590 --- ParallelTerminationStrategy: PID 22081 died... 16:02:24.185602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22081): Terminated: ok {rc=0} 16:02:24.230335 --- ParallelTerminationStrategy: PID 22082 died... 16:02:24.248712 run iperf3-srv_10.42.42.10(pid=22082): Terminated {rc=256} 16:02:24.293214 --- ParallelTerminationStrategy: PID 22083 died... 16:02:24.311844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22083): Terminated: ok {rc=0} 16:02:24.356407 --- ParallelTerminationStrategy: PID 22084 died... 16:02:24.375080 run iperf3-srv_10.42.42.10(pid=22084): Terminated {rc=256} 16:02:24.419772 --- ParallelTerminationStrategy: PID 22087 died... 16:02:24.438386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22087): Terminated: ok {rc=0} 16:02:24.482858 --- ParallelTerminationStrategy: PID 22090 died... 16:02:24.501495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22090): Terminated: ok {rc=0} 16:02:24.545840 --- ParallelTerminationStrategy: PID 22093 died... 16:02:24.564297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22093): Terminated: ok {rc=0} 16:02:24.651061 bus /gobi_0: Setting Powered False 16:02:25.750561 bus /gobi_0: Setting Powered False 16:02:26.863217 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:02:28.012269 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:28.024382 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:02:28.098976 tst iperf3.py: using LAC 29064 16:02:28.225400 tst iperf3.py: using RAC 249 16:02:28.352124 tst iperf3.py: using CellId 29064 16:02:28.481758 tst iperf3.py: using BVCI 29065 16:02:28.600081 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:28.611517 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:28.622632 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:28.633847 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:28.644890 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:28.656169 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:28.667487 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:28.678577 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:28.689893 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:28.805586 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:02:29.010379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:29.316229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22095): Launched 16:02:29.582144 run iperf3-srv_10.42.42.10(pid=22096): Launched 16:02:29.695574 tst iperf3.py:8: start network... 16:02:29.899054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:30.367259 run create_hlr_db(pid=22097): Launched 16:02:30.483318 bus /gobi_6: Setting Powered False 16:02:31.556089 run create_hlr_db(pid=22097): Terminated: ok {rc=0} 16:02:32.055635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22099): Launched 16:02:32.387814 run osmo-hlr_10.42.42.2(pid=22100): Launched 16:02:32.511080 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:33.068661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22102): Launched 16:02:33.393326 run osmo-stp_10.42.42.5(pid=22103): Launched 16:02:33.515525 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:34.075231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22105): Launched 16:02:34.199927 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:34.474621 run patchelf(pid=22106): Launched 16:02:34.654955 run osmo-stp_10.42.42.5(pid=22103): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22103)] 16:02:34.791561 run osmo-stp_10.42.42.5(pid=22103): stdout: | (launched: 2022-12-10_16:02:33.333723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:34.930607 run osmo-stp_10.42.42.5(pid=22103): stderr: | [0;m[38;5;43m20221210160233526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160233526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160233526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160233526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160233527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160233527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160233527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:35.069733 run osmo-stp_10.42.42.5(pid=22103): stdout: | (launched: 2022-12-10_16:02:33.333723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:35.202793 run osmo-stp_10.42.42.5(pid=22103): stderr: | [0;m[38;5;43m20221210160233526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160233526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160233526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160233526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160233527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160233527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160233527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:35.360398 run patchelf(pid=22106): Terminating (SIGINT) 16:02:35.542063 run patchelf(pid=22106): Terminated: ok {rc=0} 16:02:35.672884 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22103): Process ended prematurely: osmo-stp_10.42.42.5(pid=22103) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22103)] [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 16:02:35.683050 tst iperf3.py:8: Test FAILED (7.7 sec) 16:02:35.711403 run osmo-hlr_10.42.42.2(pid=22100): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22100)] 16:02:35.761232 run osmo-hlr_10.42.42.2(pid=22100): stdout: | (launched: 2022-12-10_16:02:32.328114) 16:02:35.812622 run osmo-hlr_10.42.42.2(pid=22100): stderr: | [0;m[1;31m20221210160232527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160232527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160232527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160232527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160232527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160232527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160232544 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160232554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160232554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160232554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:35.864560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22095): Terminating (SIGTERM) 16:02:35.906730 run iperf3-srv_10.42.42.10(pid=22096): Terminating (SIGTERM) 16:02:35.948781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22099): Terminating (SIGTERM) 16:02:35.991326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22102): Terminating (SIGTERM) 16:02:36.037233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22105): Terminating (SIGTERM) 16:02:36.078213 --- ParallelTerminationStrategy: PID 22095 died... 16:02:36.097332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22095): Terminated: ok {rc=0} 16:02:36.142911 --- ParallelTerminationStrategy: PID 22096 died... 16:02:36.161530 run iperf3-srv_10.42.42.10(pid=22096): Terminated {rc=256} 16:02:36.207099 --- ParallelTerminationStrategy: PID 22099 died... 16:02:36.225790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22099): Terminated: ok {rc=0} 16:02:36.271026 --- ParallelTerminationStrategy: PID 22102 died... 16:02:36.289543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22102): Terminated: ok {rc=0} 16:02:36.334732 --- ParallelTerminationStrategy: PID 22105 died... 16:02:36.353537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22105): Terminated: ok {rc=0} 16:02:36.440268 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:02:37.590673 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:37.602370 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:02:37.673086 tst iperf3m4.py: using LAC 29065 16:02:37.801372 tst iperf3m4.py: using RAC 250 16:02:37.932276 tst iperf3m4.py: using CellId 29065 16:02:38.062325 tst iperf3m4.py: using BVCI 29066 16:02:38.181550 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:38.193304 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:38.204668 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:38.216332 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:38.227730 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:38.239077 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:38.250603 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:38.261926 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:38.273600 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:38.389220 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:38.506310 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:38.620327 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:38.739892 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:02:38.947038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:39.253985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22108): Launched 16:02:39.518248 run iperf3-srv_10.42.42.10(pid=22109): Launched 16:02:39.632201 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:02:39.836546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:40.141751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22110): Launched 16:02:40.405689 run iperf3-srv_10.42.42.10(pid=22111): Launched 16:02:40.519817 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:02:40.723762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:41.029063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22112): Launched 16:02:41.293893 run iperf3-srv_10.42.42.10(pid=22113): Launched 16:02:41.407678 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:02:41.612202 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:41.917336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22114): Launched 16:02:42.181558 run iperf3-srv_10.42.42.10(pid=22115): Launched 16:02:42.295549 tst iperf3m4.py:8: start network... 16:02:42.498935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:42.969249 run create_hlr_db(pid=22116): Launched 16:02:43.086265 bus /gobi_6: Setting Powered False 16:02:44.147524 run create_hlr_db(pid=22116): Terminated: ok {rc=0} 16:02:44.571549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22118): Launched 16:02:44.875540 run osmo-hlr_10.42.42.2(pid=22119): Launched 16:02:44.991951 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:45.518798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22121): Launched 16:02:45.822261 run osmo-stp_10.42.42.5(pid=22122): Launched 16:02:46.095826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:46.629268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22124): Launched 16:02:46.757816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:47.035641 run patchelf(pid=22125): Launched 16:02:47.213189 run osmo-stp_10.42.42.5(pid=22122): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22122)] 16:02:47.345312 run osmo-stp_10.42.42.5(pid=22122): stdout: | (launched: 2022-12-10_16:02:45.766527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:47.476272 run osmo-stp_10.42.42.5(pid=22122): stderr: | [0;m[38;5;43m20221210160245942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160245943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160245943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160245943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160245953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160245953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160245953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:47.607262 run osmo-stp_10.42.42.5(pid=22122): stdout: | (launched: 2022-12-10_16:02:45.766527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:47.732266 run osmo-stp_10.42.42.5(pid=22122): stderr: | [0;m[38;5;43m20221210160245942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160245943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160245943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160245943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160245953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160245953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160245953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:47.880079 run patchelf(pid=22125): Terminating (SIGINT) 16:02:48.051345 run patchelf(pid=22125): Terminated: ok {rc=0} 16:02:48.174909 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22122): Process ended prematurely: osmo-stp_10.42.42.5(pid=22122) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22122)] [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:02:48.184310 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:02:48.212100 run osmo-hlr_10.42.42.2(pid=22119): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22119)] 16:02:48.260331 run osmo-hlr_10.42.42.2(pid=22119): stdout: | (launched: 2022-12-10_16:02:44.819803) 16:02:48.310235 run osmo-hlr_10.42.42.2(pid=22119): stderr: | [0;m[1;31m20221210160244997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160244997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160244997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160244997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160244997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160244997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160245009 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160245018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160245018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160245018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:48.360616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22108): Terminating (SIGTERM) 16:02:48.401181 run iperf3-srv_10.42.42.10(pid=22109): Terminating (SIGTERM) 16:02:48.441699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22110): Terminating (SIGTERM) 16:02:48.482001 run iperf3-srv_10.42.42.10(pid=22111): Terminating (SIGTERM) 16:02:48.522190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22112): Terminating (SIGTERM) 16:02:48.562504 run iperf3-srv_10.42.42.10(pid=22113): Terminating (SIGTERM) 16:02:48.602345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22114): Terminating (SIGTERM) 16:02:48.642220 run iperf3-srv_10.42.42.10(pid=22115): Terminating (SIGTERM) 16:02:48.681990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22118): Terminating (SIGTERM) 16:02:48.722084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22121): Terminating (SIGTERM) 16:02:48.762152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22124): Terminating (SIGTERM) 16:02:48.802569 --- ParallelTerminationStrategy: PID 22108 died... 16:02:48.822118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22108): Terminated: ok {rc=0} 16:02:48.867030 --- ParallelTerminationStrategy: PID 22109 died... 16:02:48.885715 run iperf3-srv_10.42.42.10(pid=22109): Terminated {rc=256} 16:02:48.930693 --- ParallelTerminationStrategy: PID 22110 died... 16:02:48.949287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22110): Terminated: ok {rc=0} 16:02:48.993844 --- ParallelTerminationStrategy: PID 22111 died... 16:02:49.012507 run iperf3-srv_10.42.42.10(pid=22111): Terminated {rc=256} 16:02:49.056789 --- ParallelTerminationStrategy: PID 22112 died... 16:02:49.075488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22112): Terminated: ok {rc=0} 16:02:49.120053 --- ParallelTerminationStrategy: PID 22113 died... 16:02:49.138675 run iperf3-srv_10.42.42.10(pid=22113): Terminated {rc=256} 16:02:49.183967 --- ParallelTerminationStrategy: PID 22114 died... 16:02:49.202699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22114): Terminated: ok {rc=0} 16:02:49.247440 --- ParallelTerminationStrategy: PID 22115 died... 16:02:49.266311 run iperf3-srv_10.42.42.10(pid=22115): Terminated {rc=256} 16:02:49.310840 --- ParallelTerminationStrategy: PID 22118 died... 16:02:49.329403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22118): Terminated: ok {rc=0} 16:02:49.373748 --- ParallelTerminationStrategy: PID 22121 died... 16:02:49.392745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22121): Terminated: ok {rc=0} 16:02:49.437282 --- ParallelTerminationStrategy: PID 22124 died... 16:02:49.456032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22124): Terminated: ok {rc=0} 16:02:49.541188 bus /gobi_4: Setting Powered False 16:02:50.640923 bus /gobi_4: Setting Powered False 16:02:51.757403 bus /gobi_1: Setting Powered False 16:02:52.855839 bus /gobi_1: Setting Powered False 16:02:53.974301 bus /gobi_0: Setting Powered False 16:02:55.072453 bus /gobi_0: Setting Powered False 16:02:56.189353 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:02:57.291928 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:57.303464 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:02:57.373917 tst ping.py: using LAC 29066 16:02:57.503911 tst ping.py: using RAC 251 16:02:57.622273 tst ping.py: using CellId 29066 16:02:57.738399 tst ping.py: using BVCI 29067 16:02:57.849419 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:57.860407 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:57.871327 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:57.882507 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:57.893403 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:57.904286 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:57.915462 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:57.926354 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:58.042503 tst ping.py:19: start network... 16:02:58.257204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:58.750882 run create_hlr_db(pid=22126): Launched 16:02:58.879490 bus /gobi_6: Setting Powered False 16:02:59.942123 run create_hlr_db(pid=22126): Terminated: ok {rc=0} 16:03:00.370072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22128): Launched 16:03:00.669736 run osmo-hlr_10.42.42.2(pid=22129): Launched 16:03:00.783287 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:01.408027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22132): Launched 16:03:01.823306 run osmo-stp_10.42.42.5(pid=22133): Launched 16:03:02.077928 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:02.686579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22135): Launched 16:03:02.801031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:03.053499 run patchelf(pid=22136): Launched 16:03:03.219826 run osmo-stp_10.42.42.5(pid=22133): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22133)] 16:03:03.346329 run osmo-stp_10.42.42.5(pid=22133): stdout: | (launched: 2022-12-10_16:03:01.749862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:03.475021 run osmo-stp_10.42.42.5(pid=22133): stderr: | [0;m[38;5;43m20221210160301975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160301975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160301976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160301976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160301985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160301986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160301986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:03.603297 run osmo-stp_10.42.42.5(pid=22133): stdout: | (launched: 2022-12-10_16:03:01.749862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:03.725878 run osmo-stp_10.42.42.5(pid=22133): stderr: | [0;m[38;5;43m20221210160301975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160301975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160301976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160301976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160301985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160301986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160301986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:03.870757 run patchelf(pid=22136): Terminating (SIGINT) 16:03:04.038315 run patchelf(pid=22136): Terminated: ok {rc=0} 16:03:04.159492 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22133): Process ended prematurely: osmo-stp_10.42.42.5(pid=22133) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22133)] [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 16:03:04.168342 tst ping.py:22: Test FAILED (6.9 sec) 16:03:04.195300 run osmo-hlr_10.42.42.2(pid=22129): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22129)] 16:03:04.243270 run osmo-hlr_10.42.42.2(pid=22129): stdout: | (launched: 2022-12-10_16:03:00.614553) 16:03:04.292623 run osmo-hlr_10.42.42.2(pid=22129): stderr: | [0;m[1;31m20221210160300792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160300792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160300792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160300792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160300792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160300793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160300804 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160300813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160300813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160300814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:04.342665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22128): Terminating (SIGTERM) 16:03:04.382912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22132): Terminating (SIGTERM) 16:03:04.423101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22135): Terminating (SIGTERM) 16:03:04.463524 --- ParallelTerminationStrategy: PID 22128 died... 16:03:04.482765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22128): Terminated: ok {rc=0} 16:03:04.527247 --- ParallelTerminationStrategy: PID 22132 died... 16:03:04.545845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22132): Terminated: ok {rc=0} 16:03:04.590517 --- ParallelTerminationStrategy: PID 22135 died... 16:03:04.609193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22135): Terminated: ok {rc=0} 16:03:04.695334 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:03:05.784272 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:05.796290 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:03:05.868776 tst ping_idle_ping.py: using LAC 29067 16:03:05.988355 tst ping_idle_ping.py: using RAC 252 16:03:06.104294 tst ping_idle_ping.py: using CellId 29067 16:03:06.219262 tst ping_idle_ping.py: using BVCI 29068 16:03:06.328069 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:06.338980 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:06.349633 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:06.360535 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:06.371398 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:06.382290 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:06.393216 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:06.404070 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:03:06.522463 tst ping_idle_ping.py:24: start network... 16:03:06.738800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:07.236709 run create_hlr_db(pid=22137): Launched 16:03:07.367402 bus /gobi_6: Setting Powered False 16:03:08.430743 run create_hlr_db(pid=22137): Terminated: ok {rc=0} 16:03:08.859402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22139): Launched 16:03:09.160073 run osmo-hlr_10.42.42.2(pid=22140): Launched 16:03:09.273844 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:09.802864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22142): Launched 16:03:10.102003 run osmo-stp_10.42.42.5(pid=22143): Launched 16:03:10.215805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:10.730788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22145): Launched 16:03:10.845212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:11.098092 run patchelf(pid=22146): Launched 16:03:11.263672 run osmo-stp_10.42.42.5(pid=22143): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22143)] 16:03:11.390314 run osmo-stp_10.42.42.5(pid=22143): stdout: | (launched: 2022-12-10_16:03:10.046776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:11.518815 run osmo-stp_10.42.42.5(pid=22143): stderr: | [0;m[38;5;43m20221210160310218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160310218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160310218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160310219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160310219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160310219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160310219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:11.647340 run osmo-stp_10.42.42.5(pid=22143): stdout: | (launched: 2022-12-10_16:03:10.046776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:11.770014 run osmo-stp_10.42.42.5(pid=22143): stderr: | [0;m[38;5;43m20221210160310218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160310218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160310218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160310219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160310219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160310219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160310219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:11.915703 run patchelf(pid=22146): Terminating (SIGINT) 16:03:12.083051 run patchelf(pid=22146): Terminated: ok {rc=0} 16:03:12.204128 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22143): Process ended prematurely: osmo-stp_10.42.42.5(pid=22143) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22143)] [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:03:12.213012 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:03:12.239994 run osmo-hlr_10.42.42.2(pid=22140): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22140)] 16:03:12.287581 run osmo-hlr_10.42.42.2(pid=22140): stdout: | (launched: 2022-12-10_16:03:09.104638) 16:03:12.336783 run osmo-hlr_10.42.42.2(pid=22140): stderr: | [0;m[1;31m20221210160309282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160309282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160309283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160309283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160309283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160309283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160309295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160309306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160309306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160309306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:12.386898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22139): Terminating (SIGTERM) 16:03:12.427015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22142): Terminating (SIGTERM) 16:03:12.466944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22145): Terminating (SIGTERM) 16:03:12.506942 --- ParallelTerminationStrategy: PID 22139 died... 16:03:12.525992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22139): Terminated: ok {rc=0} 16:03:12.570546 --- ParallelTerminationStrategy: PID 22142 died... 16:03:12.589121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22142): Terminated: ok {rc=0} 16:03:12.633400 --- ParallelTerminationStrategy: PID 22145 died... 16:03:12.651755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22145): Terminated: ok {rc=0} 16:03:12.734568 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:03:14.046174 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:03:14.052935 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:03:14.086753 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:03:14.125181 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:03:14.211601 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:03:14.244379 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:03:14.282635 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:03:14.882163 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:03:14.931618 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:14.942947 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:03:14.995342 tst cs_paging_gprs_active.py: using LAC 29068 16:03:15.114682 tst cs_paging_gprs_active.py: using RAC 253 16:03:15.236641 tst cs_paging_gprs_active.py: using CellId 29068 16:03:15.356534 tst cs_paging_gprs_active.py: using BVCI 29069 16:03:15.467862 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:15.479260 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:15.490478 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:15.501803 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:15.513159 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:15.524398 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:15.535806 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:15.547022 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:15.558609 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:15.679587 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:15.797150 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:03:16.020531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:16.339435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22150): Launched 16:03:16.629349 run iperf3-srv_10.42.42.10(pid=22151): Launched 16:03:16.761760 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:03:16.972305 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:17.287786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22152): Launched 16:03:17.555431 run iperf3-srv_10.42.42.10(pid=22153): Launched 16:03:17.669610 tst cs_paging_gprs_active.py:38: start network... 16:03:17.874707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:18.345430 run create_hlr_db(pid=22154): Launched 16:03:18.461373 bus /gobi_6: Setting Powered False 16:03:19.522406 run create_hlr_db(pid=22154): Terminated: ok {rc=0} 16:03:19.947627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22156): Launched 16:03:20.253088 run osmo-hlr_10.42.42.2(pid=22157): Launched 16:03:20.370241 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:20.897039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22159): Launched 16:03:21.202436 run osmo-stp_10.42.42.5(pid=22160): Launched 16:03:21.318955 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:21.845758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22162): Launched 16:03:21.962339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:22.220206 run patchelf(pid=22163): Launched 16:03:22.390319 run osmo-stp_10.42.42.5(pid=22160): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22160)] 16:03:22.519727 run osmo-stp_10.42.42.5(pid=22160): stdout: | (launched: 2022-12-10_16:03:21.146353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:22.651107 run osmo-stp_10.42.42.5(pid=22160): stderr: | [0;m[38;5;43m20221210160321316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160321316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160321316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160321317 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160321317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160321317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160321317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:22.782201 run osmo-stp_10.42.42.5(pid=22160): stdout: | (launched: 2022-12-10_16:03:21.146353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:22.907809 run osmo-stp_10.42.42.5(pid=22160): stderr: | [0;m[38;5;43m20221210160321316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160321316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160321316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160321317 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160321317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160321317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160321317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:23.055955 run patchelf(pid=22163): Terminating (SIGINT) 16:03:23.227259 run patchelf(pid=22163): Terminated: ok {rc=0} 16:03:23.350792 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22160): Process ended prematurely: osmo-stp_10.42.42.5(pid=22160) [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22160)] [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:03:23.360147 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:03:23.387942 run osmo-hlr_10.42.42.2(pid=22157): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22157)] 16:03:23.435823 run osmo-hlr_10.42.42.2(pid=22157): stdout: | (launched: 2022-12-10_16:03:20.197146) 16:03:23.485615 run osmo-hlr_10.42.42.2(pid=22157): stderr: | [0;m[1;31m20221210160320374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160320374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160320375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160320375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160320375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160320375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160320387 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160320395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160320395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160320395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:23.536095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22150): Terminating (SIGTERM) 16:03:23.576694 run iperf3-srv_10.42.42.10(pid=22151): Terminating (SIGTERM) 16:03:23.616798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22152): Terminating (SIGTERM) 16:03:23.656924 run iperf3-srv_10.42.42.10(pid=22153): Terminating (SIGTERM) 16:03:23.697127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22156): Terminating (SIGTERM) 16:03:23.737705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22159): Terminating (SIGTERM) 16:03:23.777759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22162): Terminating (SIGTERM) 16:03:23.818654 --- ParallelTerminationStrategy: PID 22150 died... 16:03:23.837824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22150): Terminated: ok {rc=0} 16:03:23.882734 --- ParallelTerminationStrategy: PID 22151 died... 16:03:23.901298 run iperf3-srv_10.42.42.10(pid=22151): Terminated {rc=256} 16:03:23.945623 --- ParallelTerminationStrategy: PID 22152 died... 16:03:23.964292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22152): Terminated: ok {rc=0} 16:03:24.009007 --- ParallelTerminationStrategy: PID 22153 died... 16:03:24.028049 run iperf3-srv_10.42.42.10(pid=22153): Terminated {rc=256} 16:03:24.072456 --- ParallelTerminationStrategy: PID 22156 died... 16:03:24.091211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22156): Terminated: ok {rc=0} 16:03:24.135752 --- ParallelTerminationStrategy: PID 22159 died... 16:03:24.154427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22159): Terminated: ok {rc=0} 16:03:24.198906 --- ParallelTerminationStrategy: PID 22162 died... 16:03:24.217627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22162): Terminated: ok {rc=0} 16:03:24.302005 bus /gobi_0: Setting Powered False 16:03:25.401081 bus /gobi_0: Setting Powered False 16:03:26.517923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:03:27.667036 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:27.679634 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:03:27.736541 tst iperf3.py: using LAC 29069 16:03:27.864752 tst iperf3.py: using RAC 254 16:03:27.992716 tst iperf3.py: using CellId 29069 16:03:28.113612 tst iperf3.py: using BVCI 29070 16:03:28.232467 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:28.244293 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:28.255921 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:28.268021 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:28.280037 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:28.292397 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:28.305105 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:28.318517 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:28.330021 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:28.445393 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:03:28.651694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:28.958939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22164): Launched 16:03:29.224666 run iperf3-srv_10.42.42.10(pid=22165): Launched 16:03:29.338884 tst iperf3.py:8: start network... 16:03:29.543087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:30.013697 run create_hlr_db(pid=22166): Launched 16:03:30.130283 bus /gobi_6: Setting Powered False 16:03:31.201773 run create_hlr_db(pid=22166): Terminated: ok {rc=0} 16:03:31.637319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22168): Launched 16:03:31.973700 run osmo-hlr_10.42.42.2(pid=22169): Launched 16:03:32.112373 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:32.761860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22171): Launched 16:03:33.085940 run osmo-stp_10.42.42.5(pid=22172): Launched 16:03:33.208125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:33.767910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22174): Launched 16:03:33.891980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:34.165777 run patchelf(pid=22175): Launched 16:03:34.346234 run osmo-stp_10.42.42.5(pid=22172): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22172)] 16:03:34.483771 run osmo-stp_10.42.42.5(pid=22172): stdout: | (launched: 2022-12-10_16:03:33.026711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:34.623163 run osmo-stp_10.42.42.5(pid=22172): stderr: | [0;m[38;5;43m20221210160333219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160333219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160333220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160333220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160333221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160333221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160333221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:34.762351 run osmo-stp_10.42.42.5(pid=22172): stdout: | (launched: 2022-12-10_16:03:33.026711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:34.895140 run osmo-stp_10.42.42.5(pid=22172): stderr: | [0;m[38;5;43m20221210160333219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160333219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160333220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160333220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160333221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160333221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160333221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:35.052559 run patchelf(pid=22175): Terminating (SIGINT) 16:03:35.234853 run patchelf(pid=22175): Terminated: ok {rc=0} 16:03:35.366297 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22172): Process ended prematurely: osmo-stp_10.42.42.5(pid=22172) [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22172)] [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:03:35.376751 tst iperf3.py:8: Test FAILED (7.7 sec) 16:03:35.405386 run osmo-hlr_10.42.42.2(pid=22169): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22169)] 16:03:35.455348 run osmo-hlr_10.42.42.2(pid=22169): stdout: | (launched: 2022-12-10_16:03:31.903420) 16:03:35.506805 run osmo-hlr_10.42.42.2(pid=22169): stderr: | [0;m[1;31m20221210160332189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160332189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160332189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160332190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160332190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160332190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160332207 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160332230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160332231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160332231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:35.559227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22164): Terminating (SIGTERM) 16:03:35.600830 run iperf3-srv_10.42.42.10(pid=22165): Terminating (SIGTERM) 16:03:35.642603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22168): Terminating (SIGTERM) 16:03:35.684368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22171): Terminating (SIGTERM) 16:03:35.726150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22174): Terminating (SIGTERM) 16:03:35.767973 --- ParallelTerminationStrategy: PID 22164 died... 16:03:35.787840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22164): Terminated: ok {rc=0} 16:03:35.834467 --- ParallelTerminationStrategy: PID 22165 died... 16:03:35.853903 run iperf3-srv_10.42.42.10(pid=22165): Terminated {rc=256} 16:03:35.899937 --- ParallelTerminationStrategy: PID 22168 died... 16:03:35.919366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22168): Terminated: ok {rc=0} 16:03:35.965276 --- ParallelTerminationStrategy: PID 22171 died... 16:03:35.984586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22171): Terminated: ok {rc=0} 16:03:36.030805 --- ParallelTerminationStrategy: PID 22174 died... 16:03:36.050306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22174): Terminated: ok {rc=0} 16:03:36.137812 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:03:37.288086 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:37.300719 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:03:37.367978 tst iperf3m4.py: using LAC 29070 16:03:37.496227 tst iperf3m4.py: using RAC 255 16:03:37.627406 tst iperf3m4.py: using CellId 29070 16:03:37.754559 tst iperf3m4.py: using BVCI 29071 16:03:37.872213 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:37.884070 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:37.895610 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:37.907217 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:37.918784 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:37.930384 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:37.942005 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:37.953490 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:37.965657 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:38.085196 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:38.209697 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:38.332268 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:38.450595 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:03:38.656761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:38.963557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22177): Launched 16:03:39.229698 run iperf3-srv_10.42.42.10(pid=22178): Launched 16:03:39.344576 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:03:39.550451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:39.858038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22179): Launched 16:03:40.124597 run iperf3-srv_10.42.42.10(pid=22180): Launched 16:03:40.239280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:03:40.444708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:40.751123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22181): Launched 16:03:41.016142 run iperf3-srv_10.42.42.10(pid=22182): Launched 16:03:41.130147 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:03:41.334178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:41.639830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22183): Launched 16:03:41.906213 run iperf3-srv_10.42.42.10(pid=22184): Launched 16:03:42.019758 tst iperf3m4.py:8: start network... 16:03:42.224428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:42.695442 run create_hlr_db(pid=22185): Launched 16:03:42.812614 bus /gobi_6: Setting Powered False 16:03:43.874021 run create_hlr_db(pid=22185): Terminated: ok {rc=0} 16:03:44.298272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22187): Launched 16:03:44.602816 run osmo-hlr_10.42.42.2(pid=22188): Launched 16:03:44.718542 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:45.245119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22190): Launched 16:03:45.550193 run osmo-stp_10.42.42.5(pid=22191): Launched 16:03:45.665778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:46.199286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22193): Launched 16:03:46.330166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:46.597507 run patchelf(pid=22194): Launched 16:03:46.783661 run osmo-stp_10.42.42.5(pid=22191): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22191)] 16:03:46.916226 run osmo-stp_10.42.42.5(pid=22191): stdout: | (launched: 2022-12-10_16:03:45.494279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:47.050288 run osmo-stp_10.42.42.5(pid=22191): stderr: | [0;m[38;5;43m20221210160345665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160345665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160345666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160345666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160345667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160345667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160345667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:47.184019 run osmo-stp_10.42.42.5(pid=22191): stdout: | (launched: 2022-12-10_16:03:45.494279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:47.308909 run osmo-stp_10.42.42.5(pid=22191): stderr: | [0;m[38;5;43m20221210160345665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160345665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160345666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160345666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160345667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160345667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160345667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:47.456406 run patchelf(pid=22194): Terminating (SIGINT) 16:03:47.639432 run patchelf(pid=22194): Terminated: ok {rc=0} 16:03:47.772039 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22191): Process ended prematurely: osmo-stp_10.42.42.5(pid=22191) [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22191)] [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:03:47.782604 tst iperf3m4.py:8: Test FAILED (10.5 sec) 16:03:47.811517 run osmo-hlr_10.42.42.2(pid=22188): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22188)] 16:03:47.861626 run osmo-hlr_10.42.42.2(pid=22188): stdout: | (launched: 2022-12-10_16:03:44.546549) 16:03:47.913740 run osmo-hlr_10.42.42.2(pid=22188): stderr: | [0;m[1;31m20221210160344725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160344725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160344725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160344725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160344725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160344725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160344740 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160344749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160344749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160344749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:47.965679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22177): Terminating (SIGTERM) 16:03:48.007459 run iperf3-srv_10.42.42.10(pid=22178): Terminating (SIGTERM) 16:03:48.049089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22179): Terminating (SIGTERM) 16:03:48.090579 run iperf3-srv_10.42.42.10(pid=22180): Terminating (SIGTERM) 16:03:48.132087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22181): Terminating (SIGTERM) 16:03:48.173736 run iperf3-srv_10.42.42.10(pid=22182): Terminating (SIGTERM) 16:03:48.215322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22183): Terminating (SIGTERM) 16:03:48.257015 run iperf3-srv_10.42.42.10(pid=22184): Terminating (SIGTERM) 16:03:48.298508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22187): Terminating (SIGTERM) 16:03:48.340238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22190): Terminating (SIGTERM) 16:03:48.382333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22193): Terminating (SIGTERM) 16:03:48.424355 --- ParallelTerminationStrategy: PID 22177 died... 16:03:48.444573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22177): Terminated: ok {rc=0} 16:03:48.491225 --- ParallelTerminationStrategy: PID 22178 died... 16:03:48.510807 run iperf3-srv_10.42.42.10(pid=22178): Terminated {rc=256} 16:03:48.556899 --- ParallelTerminationStrategy: PID 22179 died... 16:03:48.576832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22179): Terminated: ok {rc=0} 16:03:48.623484 --- ParallelTerminationStrategy: PID 22180 died... 16:03:48.643055 run iperf3-srv_10.42.42.10(pid=22180): Terminated {rc=256} 16:03:48.689265 --- ParallelTerminationStrategy: PID 22181 died... 16:03:48.708926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22181): Terminated: ok {rc=0} 16:03:48.754925 --- ParallelTerminationStrategy: PID 22182 died... 16:03:48.774516 run iperf3-srv_10.42.42.10(pid=22182): Terminated {rc=256} 16:03:48.820460 --- ParallelTerminationStrategy: PID 22183 died... 16:03:48.839920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22183): Terminated: ok {rc=0} 16:03:48.885909 --- ParallelTerminationStrategy: PID 22184 died... 16:03:48.905505 run iperf3-srv_10.42.42.10(pid=22184): Terminated {rc=256} 16:03:48.951365 --- ParallelTerminationStrategy: PID 22187 died... 16:03:48.971035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22187): Terminated: ok {rc=0} 16:03:49.017356 --- ParallelTerminationStrategy: PID 22190 died... 16:03:49.037020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22190): Terminated: ok {rc=0} 16:03:49.083198 --- ParallelTerminationStrategy: PID 22193 died... 16:03:49.102968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22193): Terminated: ok {rc=0} 16:03:49.190549 bus /gobi_4: Setting Powered False 16:03:50.290837 bus /gobi_4: Setting Powered False 16:03:51.408103 bus /gobi_1: Setting Powered False 16:03:52.506235 bus /gobi_1: Setting Powered False 16:03:53.622391 bus /gobi_0: Setting Powered False 16:03:54.721161 bus /gobi_0: Setting Powered False 16:03:55.835622 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:03:56.937994 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:56.950635 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:03:57.005719 tst ping.py: using LAC 29071 16:03:57.132722 tst ping.py: using RAC 1 16:03:57.257463 tst ping.py: using CellId 29071 16:03:57.382795 tst ping.py: using BVCI 29072 16:03:57.498862 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:57.510885 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:57.522683 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:57.534338 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:57.545958 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:57.557849 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:57.570179 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:57.582061 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:57.701071 tst ping.py:19: start network... 16:03:57.916135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:58.412288 run create_hlr_db(pid=22195): Launched 16:03:58.542484 bus /gobi_6: Setting Powered False 16:03:59.605911 run create_hlr_db(pid=22195): Terminated: ok {rc=0} 16:04:00.034684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22197): Launched 16:04:00.332718 run osmo-hlr_10.42.42.2(pid=22198): Launched 16:04:00.446595 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:00.997723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22200): Launched 16:04:01.323058 run osmo-stp_10.42.42.5(pid=22201): Launched 16:04:01.561307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:02.212798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22203): Launched 16:04:02.332142 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:02.585694 run patchelf(pid=22204): Launched 16:04:02.751679 run osmo-stp_10.42.42.5(pid=22201): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22201)] 16:04:02.878538 run osmo-stp_10.42.42.5(pid=22201): stdout: | (launched: 2022-12-10_16:04:01.250897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:03.007437 run osmo-stp_10.42.42.5(pid=22201): stderr: | [0;m[38;5;43m20221210160401579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160401580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160401580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160401580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160401589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160401589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160401589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:03.135997 run osmo-stp_10.42.42.5(pid=22201): stdout: | (launched: 2022-12-10_16:04:01.250897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:03.259120 run osmo-stp_10.42.42.5(pid=22201): stderr: | [0;m[38;5;43m20221210160401579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160401580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160401580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160401580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160401589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160401589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160401589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:03.404634 run patchelf(pid=22204): Terminating (SIGINT) 16:04:03.572308 run patchelf(pid=22204): Terminated: ok {rc=0} 16:04:03.693579 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22201): Process ended prematurely: osmo-stp_10.42.42.5(pid=22201) [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22201)] [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:04:03.702387 tst ping.py:22: Test FAILED (6.8 sec) 16:04:03.729720 run osmo-hlr_10.42.42.2(pid=22198): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22198)] 16:04:03.777521 run osmo-hlr_10.42.42.2(pid=22198): stdout: | (launched: 2022-12-10_16:04:00.277754) 16:04:03.827181 run osmo-hlr_10.42.42.2(pid=22198): stderr: | [0;m[1;31m20221210160400456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160400456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160400456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160400456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160400456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160400456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160400469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160400477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160400477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160400477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:03.877409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22197): Terminating (SIGTERM) 16:04:03.927437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22200): Terminating (SIGTERM) 16:04:03.967099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22203): Terminating (SIGTERM) 16:04:04.007059 --- ParallelTerminationStrategy: PID 22197 died... 16:04:04.026156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22197): Terminated: ok {rc=0} 16:04:04.070585 --- ParallelTerminationStrategy: PID 22200 died... 16:04:04.089189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22200): Terminated: ok {rc=0} 16:04:04.133437 --- ParallelTerminationStrategy: PID 22203 died... 16:04:04.151930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22203): Terminated: ok {rc=0} 16:04:04.238501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:04:05.327284 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:05.339858 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:04:05.394309 tst ping_idle_ping.py: using LAC 29072 16:04:05.513177 tst ping_idle_ping.py: using RAC 2 16:04:05.632770 tst ping_idle_ping.py: using CellId 29072 16:04:05.750718 tst ping_idle_ping.py: using BVCI 29073 16:04:05.859496 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:05.871052 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:05.882387 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:05.893797 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:05.904917 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:05.916396 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:05.927895 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:05.939182 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:04:06.053815 tst ping_idle_ping.py:24: start network... 16:04:06.256396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:06.724367 run create_hlr_db(pid=22205): Launched 16:04:06.839244 bus /gobi_6: Setting Powered False 16:04:07.899446 run create_hlr_db(pid=22205): Terminated: ok {rc=0} 16:04:08.338449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22207): Launched 16:04:08.660411 run osmo-hlr_10.42.42.2(pid=22208): Launched 16:04:08.782569 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:09.336519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22210): Launched 16:04:09.656906 run osmo-stp_10.42.42.5(pid=22211): Launched 16:04:09.778644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:10.330869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22213): Launched 16:04:10.453425 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:10.722477 run patchelf(pid=22214): Launched 16:04:10.899321 run osmo-stp_10.42.42.5(pid=22211): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22211)] 16:04:11.034338 run osmo-stp_10.42.42.5(pid=22211): stdout: | (launched: 2022-12-10_16:04:09.598323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:11.170909 run osmo-stp_10.42.42.5(pid=22211): stderr: | [0;m[38;5;43m20221210160409791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160409791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160409792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160409792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160409794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160409794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160409794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:11.307498 run osmo-stp_10.42.42.5(pid=22211): stdout: | (launched: 2022-12-10_16:04:09.598323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:11.438869 run osmo-stp_10.42.42.5(pid=22211): stderr: | [0;m[38;5;43m20221210160409791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160409791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160409792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160409792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160409794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160409794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160409794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:11.593779 run patchelf(pid=22214): Terminating (SIGINT) 16:04:11.772322 run patchelf(pid=22214): Terminated: ok {rc=0} 16:04:11.901566 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22211): Process ended prematurely: osmo-stp_10.42.42.5(pid=22211) [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22211)] [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:04:11.911614 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:04:11.940580 run osmo-hlr_10.42.42.2(pid=22208): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22208)] 16:04:11.990889 run osmo-hlr_10.42.42.2(pid=22208): stdout: | (launched: 2022-12-10_16:04:08.602002) 16:04:12.042904 run osmo-hlr_10.42.42.2(pid=22208): stderr: | [0;m[1;31m20221210160408800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160408800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160408800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160408800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160408800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160408800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160408813 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160408822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160408822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160408822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:12.095173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22207): Terminating (SIGTERM) 16:04:12.137334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22210): Terminating (SIGTERM) 16:04:12.178931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22213): Terminating (SIGTERM) 16:04:12.220845 --- ParallelTerminationStrategy: PID 22207 died... 16:04:12.240788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22207): Terminated: ok {rc=0} 16:04:12.286778 --- ParallelTerminationStrategy: PID 22210 died... 16:04:12.306248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22210): Terminated: ok {rc=0} 16:04:12.352209 --- ParallelTerminationStrategy: PID 22213 died... 16:04:12.371805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22213): Terminated: ok {rc=0} 16:04:12.459152 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:04:13.775656 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:13.783226 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:04:13.817634 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:04:13.853178 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:04:13.907706 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:04:13.941305 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:04:13.976078 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:04:14.535951 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:04:14.541194 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:14.553329 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:04:14.623782 tst switch_tch_pdch.py: using LAC 29073 16:04:14.746867 tst switch_tch_pdch.py: using RAC 3 16:04:14.870885 tst switch_tch_pdch.py: using CellId 29073 16:04:14.994520 tst switch_tch_pdch.py: using BVCI 29074 16:04:15.110102 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:15.121907 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:15.133473 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:15.144942 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:15.156505 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:15.168003 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:15.179725 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:15.191302 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:04:15.309074 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:04:15.425814 tst switch_tch_pdch.py:51: start network... 16:04:15.627067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:16.098319 run create_hlr_db(pid=22218): Launched 16:04:16.243682 bus /gobi_6: Setting Powered False 16:04:17.309168 run create_hlr_db(pid=22218): Terminated: ok {rc=0} 16:04:17.738140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22220): Launched 16:04:18.036428 run osmo-hlr_10.42.42.2(pid=22221): Launched 16:04:18.150886 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:18.675765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22223): Launched 16:04:18.973933 run osmo-stp_10.42.42.5(pid=22224): Launched 16:04:19.087159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:19.602821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22226): Launched 16:04:19.716658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:19.969280 run patchelf(pid=22227): Launched 16:04:20.135096 run osmo-stp_10.42.42.5(pid=22224): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22224)] 16:04:20.261615 run osmo-stp_10.42.42.5(pid=22224): stdout: | (launched: 2022-12-10_16:04:18.919160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:20.389653 run osmo-stp_10.42.42.5(pid=22224): stderr: | [0;m[38;5;43m20221210160419088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160419088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160419088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160419089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160419091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160419091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160419091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:20.518226 run osmo-stp_10.42.42.5(pid=22224): stdout: | (launched: 2022-12-10_16:04:18.919160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:20.640614 run osmo-stp_10.42.42.5(pid=22224): stderr: | [0;m[38;5;43m20221210160419088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160419088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160419088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160419089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160419091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160419091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160419091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:20.785862 run patchelf(pid=22227): Terminating (SIGINT) 16:04:20.953843 run patchelf(pid=22227): Terminated: ok {rc=0} 16:04:21.074626 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22224): Process ended prematurely: osmo-stp_10.42.42.5(pid=22224) [trial-2376↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22224)] [trial-2376↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:04:21.083354 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:04:21.110381 run osmo-hlr_10.42.42.2(pid=22221): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22221)] 16:04:21.157794 run osmo-hlr_10.42.42.2(pid=22221): stdout: | (launched: 2022-12-10_16:04:17.981224) 16:04:21.207308 run osmo-hlr_10.42.42.2(pid=22221): stderr: | [0;m[1;31m20221210160418158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160418158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160418158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160418158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160418159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160418159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160418171 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160418179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160418179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160418179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:21.256940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22220): Terminating (SIGTERM) 16:04:21.297135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22223): Terminating (SIGTERM) 16:04:21.336885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22226): Terminating (SIGTERM) 16:04:21.377157 --- ParallelTerminationStrategy: PID 22220 died... 16:04:21.396295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22220): Terminated: ok {rc=0} 16:04:21.441130 --- ParallelTerminationStrategy: PID 22223 died... 16:04:21.459881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22223): Terminated: ok {rc=0} 16:04:21.504458 --- ParallelTerminationStrategy: PID 22226 died... 16:04:21.523323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22226): Terminated: ok {rc=0} 16:04:21.609987 bus /gobi_0: Setting Powered False 16:04:22.712686 bus /gobi_0: Setting Powered False 16:04:23.830696 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:04:25.092165 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:25.098042 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:04:25.131584 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:04:25.166064 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:04:25.218868 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:04:25.253306 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:04:25.288853 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:04:25.848541 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:04:25.855077 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:25.866920 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:04:25.936312 tst switch_tch_pdch.py: using LAC 29074 16:04:26.061672 tst switch_tch_pdch.py: using RAC 4 16:04:26.184735 tst switch_tch_pdch.py: using CellId 29074 16:04:26.311373 tst switch_tch_pdch.py: using BVCI 29075 16:04:26.427905 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:26.439492 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:26.450988 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:26.462511 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:26.473865 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:26.485233 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:26.496583 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:26.507900 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:04:26.623478 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:04:26.738455 tst switch_tch_pdch.py:51: start network... 16:04:26.938187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:27.373173 run create_hlr_db(pid=22232): Launched 16:04:27.487767 bus /gobi_6: Setting Powered False 16:04:28.546981 run create_hlr_db(pid=22232): Terminated: ok {rc=0} 16:04:28.956832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22234): Launched 16:04:29.274445 run osmo-hlr_10.42.42.2(pid=22235): Launched 16:04:29.395298 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:29.917373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22237): Launched 16:04:30.235549 run osmo-stp_10.42.42.5(pid=22238): Launched 16:04:30.357157 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:30.883940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22240): Launched 16:04:31.021931 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:31.289837 run patchelf(pid=22241): Launched 16:04:31.478259 run osmo-stp_10.42.42.5(pid=22238): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22238)] 16:04:31.613081 run osmo-stp_10.42.42.5(pid=22238): stdout: | (launched: 2022-12-10_16:04:30.177525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:31.747831 run osmo-stp_10.42.42.5(pid=22238): stderr: | [0;m[38;5;43m20221210160430369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160430369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160430369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160430370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160430370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160430370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160430370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:31.884002 run osmo-stp_10.42.42.5(pid=22238): stdout: | (launched: 2022-12-10_16:04:30.177525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:32.012488 run osmo-stp_10.42.42.5(pid=22238): stderr: | [0;m[38;5;43m20221210160430369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160430369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160430369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160430370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160430370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160430370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160430370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:32.163579 run patchelf(pid=22241): Terminating (SIGINT) 16:04:32.334308 run patchelf(pid=22241): Terminated: ok {rc=0} 16:04:32.456237 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22238): Process ended prematurely: osmo-stp_10.42.42.5(pid=22238) [trial-2376↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22238)] [trial-2376↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:04:32.465409 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 16:04:32.493100 run osmo-hlr_10.42.42.2(pid=22235): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22235)] 16:04:32.542671 run osmo-hlr_10.42.42.2(pid=22235): stdout: | (launched: 2022-12-10_16:04:29.216266) 16:04:32.593533 run osmo-hlr_10.42.42.2(pid=22235): stderr: | [0;m[1;31m20221210160429413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160429413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160429413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160429413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160429413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160429413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160429425 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160429433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160429433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160429434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:32.644457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22234): Terminating (SIGTERM) 16:04:32.685435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22237): Terminating (SIGTERM) 16:04:32.726340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22240): Terminating (SIGTERM) 16:04:32.767774 --- ParallelTerminationStrategy: PID 22234 died... 16:04:32.787065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22234): Terminated: ok {rc=0} 16:04:32.833517 --- ParallelTerminationStrategy: PID 22237 died... 16:04:32.852645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22237): Terminated: ok {rc=0} 16:04:32.899374 --- ParallelTerminationStrategy: PID 22240 died... 16:04:32.918382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22240): Terminated: ok {rc=0} 16:04:33.006925 bus /gobi_0: Setting Powered False 16:04:34.108207 bus /gobi_0: Setting Powered False 16:04:35.223610 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 16:04:36.478820 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:36.482789 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:04:36.517316 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 16:04:36.524216 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:04:36.578193 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:04:36.613925 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 16:04:36.621127 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:04:37.153511 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 16:04:37.159282 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 16:04:37.170853 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:04:37.220426 tst mo_mt_sms.py: using LAC 29075 16:04:37.338531 tst mo_mt_sms.py: using RAC 5 16:04:37.455620 tst mo_mt_sms.py: using CellId 29075 16:04:37.573458 tst mo_mt_sms.py: using BVCI 29076 16:04:37.683447 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:04:37.798648 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:04:37.909372 tst mo_mt_sms.py:9: start nitb and bts... 16:04:38.109822 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:04:38.717752 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22245): Launched 16:04:39.017287 run osmo-nitb_10.42.42.2(pid=22246): Launched 16:04:39.184177 run osmo-nitb_10.42.42.2(pid=22246): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22246)] 16:04:39.318334 run osmo-nitb_10.42.42.2(pid=22246): stdout: | (launched: 2022-12-10_16:04:38.961949) 16:04:39.454152 run osmo-nitb_10.42.42.2(pid=22246): stderr: | (launched: 2022-12-10_16:04:39.006377) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:04:39.589643 run osmo-nitb_10.42.42.2(pid=22246): stdout: | (launched: 2022-12-10_16:04:38.961949) 16:04:39.719363 run osmo-nitb_10.42.42.2(pid=22246): stderr: | (launched: 2022-12-10_16:04:39.006377) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22246): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22246) [trial-2376↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22246)] 16:04:40.131697 tst osmo-nitb_10.42.42.2(pid=22246): stdout: | (launched: 2022-12-10_16:04:38.961949) 16:04:40.253491 tst osmo-nitb_10.42.42.2(pid=22246): stderr: | (launched: 2022-12-10_16:04:39.006377) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:04:40.396094 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22246): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22246) [trial-2376↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22246)] [trial-2376↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 16:04:40.404563 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 16:04:40.411149 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22245): Terminating (SIGTERM) 16:04:40.622620 --- ParallelTerminationStrategy: PID 22245 died... 16:04:40.643466 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22245): Terminated: ok {rc=0} 16:04:40.731209 bus /sierra_3: Setting Powered False 16:04:41.833075 bus /sierra_3: Setting Powered False 16:04:42.949467 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 sms:trx-sysmocell5000 --------------------------------------------------------------------- 16:04:44.151931 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:44.156637 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:04:44.191731 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:04:44.218665 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:04:44.270354 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:04:44.304836 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:04:44.332289 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:04:44.881065 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 16:04:44.886428 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:44.897839 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:04:44.947309 tst mo_mt_sms.py: using LAC 29076 16:04:45.074165 tst mo_mt_sms.py: using RAC 6 16:04:45.200534 tst mo_mt_sms.py: using CellId 29076 16:04:45.327364 tst mo_mt_sms.py: using BVCI 29077 16:04:45.444621 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:45.455896 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:45.467198 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:45.478282 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:45.489313 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:45.500312 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:04:45.613622 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:04:45.731603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:46.256342 run create_hlr_db(pid=22251): Launched 16:04:46.411625 bus /sierra_2: Setting Powered False 16:04:47.471787 run create_hlr_db(pid=22251): Terminated: ok {rc=0} 16:04:47.915832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22253): Launched 16:04:48.234360 run osmo-hlr_10.42.42.2(pid=22254): Launched 16:04:48.356493 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:48.904224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22257): Launched 16:04:49.222824 run osmo-stp_10.42.42.5(pid=22258): Launched 16:04:49.345920 run osmo-msc_10.42.42.6: Starting osmo-msc 16:04:49.923264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22260): Launched 16:04:50.243414 run osmo-msc_10.42.42.6(pid=22261): Launched 16:04:50.420891 run osmo-stp_10.42.42.5(pid=22258): ERR: Terminated: ERROR {rc=1} [trial-2376↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22258)] 16:04:50.554915 run osmo-stp_10.42.42.5(pid=22258): stdout: | (launched: 2022-12-10_16:04:49.164582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:50.689397 run osmo-stp_10.42.42.5(pid=22258): stderr: | [0;m[38;5;43m20221210160449355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160449355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160449356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160449356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160449358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160449359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160449359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:50.823398 run osmo-stp_10.42.42.5(pid=22258): stdout: | (launched: 2022-12-10_16:04:49.164582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:50.950587 run osmo-stp_10.42.42.5(pid=22258): stderr: | [0;m[38;5;43m20221210160449355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160449355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160449356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160449356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160449358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160449359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160449359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:51.102834 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22258): Process ended prematurely: osmo-stp_10.42.42.5(pid=22258) [trial-2376↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22258)] [trial-2376↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 16:04:51.111548 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 16:04:51.138962 run osmo-hlr_10.42.42.2(pid=22254): ERR: Terminated: ERROR {rc=237} [trial-2376↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22254)] 16:04:51.190319 run osmo-hlr_10.42.42.2(pid=22254): stdout: | (launched: 2022-12-10_16:04:48.175875) 16:04:51.242634 run osmo-hlr_10.42.42.2(pid=22254): stderr: | [0;m[1;31m20221210160448374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160448374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160448374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160448374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160448374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160448374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160448386 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160448396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160448396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160448396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:51.315530 run osmo-msc_10.42.42.6(pid=22261): ERR: Terminated: ERROR {rc=2} [trial-2376↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22261)] 16:04:51.365842 run osmo-msc_10.42.42.6(pid=22261): stdout: | (launched: 2022-12-10_16:04:50.184207) 16:04:51.417964 run osmo-msc_10.42.42.6(pid=22261): stderr: | [0;m[38;5;43m20221210160450508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160450509 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9a97745c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160450509 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160450509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160450509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160450509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160450511 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160450511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160450511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160450511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:04:51.470392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22253): Terminating (SIGTERM) 16:04:51.512575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22257): Terminating (SIGTERM) 16:04:51.554958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22260): Terminating (SIGTERM) 16:04:51.597660 --- ParallelTerminationStrategy: PID 22253 died... 16:04:51.617927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22253): Terminated: ok {rc=0} 16:04:51.664838 --- ParallelTerminationStrategy: PID 22257 died... 16:04:51.684641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22257): Terminated: ok {rc=0} 16:04:51.731119 --- ParallelTerminationStrategy: PID 22260 died... 16:04:51.750926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22260): Terminated: ok {rc=0} 16:04:51.838753 bus /sierra_3: Setting Powered False 16:04:52.938860 bus /sierra_3: Setting Powered False 16:04:54.056434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 16:04:55.295486 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:55.299644 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:04:55.334151 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 16:04:55.340911 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 16:04:55.374314 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:04:55.408349 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 16:04:55.415223 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 16:04:55.935884 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2376 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 16:04:55.941179 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 16:04:55.952268 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:04:56.001348 tst assert_extension.py: using LAC 29077 16:04:56.118191 tst assert_extension.py: using RAC 7 16:04:56.235773 tst assert_extension.py: using CellId 29077 16:04:56.360618 tst assert_extension.py: using BVCI 29078 16:04:56.477874 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 16:04:56.591965 tst assert_extension.py:10: start nitb and bts... 16:04:56.793519 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:04:57.405463 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22266): Launched 16:04:57.705743 run osmo-nitb_10.42.42.2(pid=22267): Launched 16:04:57.871628 run osmo-nitb_10.42.42.2(pid=22267): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22267)] 16:04:58.006206 run osmo-nitb_10.42.42.2(pid=22267): stdout: | (launched: 2022-12-10_16:04:57.650505) 16:04:58.143041 run osmo-nitb_10.42.42.2(pid=22267): stderr: | (launched: 2022-12-10_16:04:57.695054) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:04:58.279331 run osmo-nitb_10.42.42.2(pid=22267): stdout: | (launched: 2022-12-10_16:04:57.650505) 16:04:58.410468 run osmo-nitb_10.42.42.2(pid=22267): stderr: | (launched: 2022-12-10_16:04:57.695054) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22267): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22267) [trial-2376↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22267)] 16:04:58.818661 tst osmo-nitb_10.42.42.2(pid=22267): stdout: | (launched: 2022-12-10_16:04:57.650505) 16:04:58.940898 tst osmo-nitb_10.42.42.2(pid=22267): stderr: | (launched: 2022-12-10_16:04:57.695054) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:04:59.084038 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22267): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22267) [trial-2376↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22267)] [trial-2376↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 16:04:59.092440 tst assert_extension.py:12: Test FAILED (3.1 sec) 16:04:59.099122 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22266): Terminating (SIGTERM) 16:04:59.309157 --- ParallelTerminationStrategy: PID 22266 died... 16:04:59.329599 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22266): Terminated: ok {rc=0} 16:04:59.415968 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 16:05:00.598633 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:05:00.602994 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:05:00.638153 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:05:00.665992 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 16:05:00.701907 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:05:00.737054 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:05:00.764824 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 16:05:01.332752 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 16:05:01.339455 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:05:01.350914 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:05:01.404827 tst assert_extension.py: using LAC 29078 16:05:01.570475 tst assert_extension.py: using RAC 8 16:05:01.715957 tst assert_extension.py: using CellId 29078 16:05:01.842590 tst assert_extension.py: using BVCI 29079 16:05:01.978560 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:05:01.990587 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:05:02.002524 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:05:02.014821 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:05:02.027190 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:05:02.040163 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 16:05:02.157284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:02.657755 run create_hlr_db(pid=22274): Launched 16:05:02.788298 bus /sierra_2: Setting Powered False 16:05:03.852246 run create_hlr_db(pid=22274): Terminated: ok {rc=0} 16:05:04.296164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22276): Launched 16:05:04.616022 run osmo-hlr_10.42.42.2(pid=22277): Launched 16:05:04.736516 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:05.376231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22279): Launched 16:05:05.690128 run osmo-stp_10.42.42.5(pid=22280): Launched 16:05:05.809407 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:06.376008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22282): Launched 16:05:06.689519 run osmo-msc_10.42.42.6(pid=22283): Launched 16:05:06.864194 run osmo-stp_10.42.42.5(pid=22280): ERR: Terminated: ERROR {rc=1} [trial-2376↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22280)] 16:05:06.996334 run osmo-stp_10.42.42.5(pid=22280): stdout: | (launched: 2022-12-10_16:05:05.632694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:07.129342 run osmo-stp_10.42.42.5(pid=22280): stderr: | [0;m[38;5;43m20221210160505825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160505825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160505825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160505825 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160505826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160505826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160505826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:07.261453 run osmo-stp_10.42.42.5(pid=22280): stdout: | (launched: 2022-12-10_16:05:05.632694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:07.387033 run osmo-stp_10.42.42.5(pid=22280): stderr: | [0;m[38;5;43m20221210160505825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160505825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160505825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160505825 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160505826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160505826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160505826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:07.537837 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22280): Process ended prematurely: osmo-stp_10.42.42.5(pid=22280) [trial-2376↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22280)] [trial-2376↪ussd:trx-sysmocell5000↪assert_extension.py:17] 16:05:07.546630 tst assert_extension.py:17: Test FAILED (6.2 sec) 16:05:07.573949 run osmo-hlr_10.42.42.2(pid=22277): ERR: Terminated: ERROR {rc=237} [trial-2376↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22277)] 16:05:07.623836 run osmo-hlr_10.42.42.2(pid=22277): stdout: | (launched: 2022-12-10_16:05:04.557768) 16:05:07.675324 run osmo-hlr_10.42.42.2(pid=22277): stderr: | [0;m[1;31m20221210160504757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160504757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160504757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160504757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160504757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160504757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160504769 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160504777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160504777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160504777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:07.746855 run osmo-msc_10.42.42.6(pid=22283): ERR: Terminated: ERROR {rc=2} [trial-2376↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22283)] 16:05:07.796544 run osmo-msc_10.42.42.6(pid=22283): stdout: | (launched: 2022-12-10_16:05:06.632072) 16:05:07.847723 run osmo-msc_10.42.42.6(pid=22283): stderr: | [0;m[38;5;43m20221210160506952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160506952 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb199007c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160506952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160506952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160506952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160506953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160506954 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160506955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160506955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160506955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:07.899479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22276): Terminating (SIGTERM) 16:05:07.941136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22279): Terminating (SIGTERM) 16:05:07.983036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22282): Terminating (SIGTERM) 16:05:08.025251 --- ParallelTerminationStrategy: PID 22276 died... 16:05:08.045366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22276): Terminated: ok {rc=0} 16:05:08.091811 --- ParallelTerminationStrategy: PID 22279 died... 16:05:08.111481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22279): Terminated: ok {rc=0} 16:05:08.157828 --- ParallelTerminationStrategy: PID 22282 died... 16:05:08.177544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22282): Terminated: ok {rc=0} 16:05:08.265884 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:05:09.480818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:05:09.488188 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:05:09.523194 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:05:09.550480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:05:09.603028 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:05:09.637250 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:05:09.664207 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:05:10.218235 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:05:10.269890 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:10.281547 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:05:10.353426 tst mo_mt_call.py: using LAC 29079 16:05:10.479157 tst mo_mt_call.py: using RAC 9 16:05:10.604411 tst mo_mt_call.py: using CellId 29079 16:05:10.731936 tst mo_mt_call.py: using BVCI 29080 16:05:10.849264 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:10.860852 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:10.872301 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:10.883854 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:10.895341 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:10.906754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:05:11.022126 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:05:11.139197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:11.635411 run create_hlr_db(pid=22288): Launched 16:05:11.764794 bus /sierra_2: Setting Powered False 16:05:12.828614 run create_hlr_db(pid=22288): Terminated: ok {rc=0} 16:05:13.258823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22290): Launched 16:05:13.559021 run osmo-hlr_10.42.42.2(pid=22291): Launched 16:05:13.673675 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:14.195207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22293): Launched 16:05:14.516546 run osmo-stp_10.42.42.5(pid=22294): Launched 16:05:14.638047 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:15.214224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22296): Launched 16:05:15.534977 run osmo-msc_10.42.42.6(pid=22297): Launched 16:05:15.711813 run osmo-stp_10.42.42.5(pid=22294): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22294)] 16:05:15.855634 run osmo-stp_10.42.42.5(pid=22294): stdout: | (launched: 2022-12-10_16:05:14.458388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:16.104798 run osmo-stp_10.42.42.5(pid=22294): stderr: | [0;m[38;5;43m20221210160514651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160514651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160514652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160514652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160514653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160514653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160514653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:16.240247 run osmo-stp_10.42.42.5(pid=22294): stdout: | (launched: 2022-12-10_16:05:14.458388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:16.369962 run osmo-stp_10.42.42.5(pid=22294): stderr: | [0;m[38;5;43m20221210160514651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160514651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160514652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160514652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160514653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160514653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160514653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:16.526709 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22294): Process ended prematurely: osmo-stp_10.42.42.5(pid=22294) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22294)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:05:16.536601 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:05:16.565449 run osmo-hlr_10.42.42.2(pid=22291): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22291)] 16:05:16.616156 run osmo-hlr_10.42.42.2(pid=22291): stdout: | (launched: 2022-12-10_16:05:13.504098) 16:05:16.669190 run osmo-hlr_10.42.42.2(pid=22291): stderr: | [0;m[1;31m20221210160513679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160513679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160513679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160513679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160513679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160513679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160513691 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160513700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160513700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160513700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:16.742005 run osmo-msc_10.42.42.6(pid=22297): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22297)] 16:05:16.792637 run osmo-msc_10.42.42.6(pid=22297): stdout: | (launched: 2022-12-10_16:05:15.476220) 16:05:16.844591 run osmo-msc_10.42.42.6(pid=22297): stderr: | [0;m[38;5;43m20221210160515801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160515801 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd69b9b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160515802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160515802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160515802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160515802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160515804 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160515804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160515804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160515804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:16.897321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22290): Terminating (SIGTERM) 16:05:16.940057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22293): Terminating (SIGTERM) 16:05:16.983699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22296): Terminating (SIGTERM) 16:05:17.027014 --- ParallelTerminationStrategy: PID 22290 died... 16:05:17.047071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22290): Terminated: ok {rc=0} 16:05:17.095577 --- ParallelTerminationStrategy: PID 22293 died... 16:05:17.115650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22293): Terminated: ok {rc=0} 16:05:17.162609 --- ParallelTerminationStrategy: PID 22296 died... 16:05:17.182698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22296): Terminated: ok {rc=0} 16:05:17.271074 bus /sierra_3: Setting Powered False 16:05:18.371652 bus /sierra_3: Setting Powered False 16:05:19.486886 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:05:20.630960 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:20.643074 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:05:20.711892 tst mo_mt_call_osmux.py: using LAC 29080 16:05:20.829308 tst mo_mt_call_osmux.py: using RAC 10 16:05:20.945550 tst mo_mt_call_osmux.py: using CellId 29080 16:05:21.069339 tst mo_mt_call_osmux.py: using BVCI 29081 16:05:21.184596 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:21.196300 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:21.207913 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:21.219457 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:21.231476 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:21.243007 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:05:21.358816 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:05:21.474548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:21.939828 run create_hlr_db(pid=22299): Launched 16:05:22.055215 bus /sierra_2: Setting Powered False 16:05:23.115005 run create_hlr_db(pid=22299): Terminated: ok {rc=0} 16:05:23.555386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22301): Launched 16:05:23.876023 run osmo-hlr_10.42.42.2(pid=22302): Launched 16:05:23.997567 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:24.550068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22304): Launched 16:05:24.869689 run osmo-stp_10.42.42.5(pid=22305): Launched 16:05:24.990869 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:25.569609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22307): Launched 16:05:25.889262 run osmo-msc_10.42.42.6(pid=22308): Launched 16:05:26.066734 run osmo-stp_10.42.42.5(pid=22305): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22305)] 16:05:26.200886 run osmo-stp_10.42.42.5(pid=22305): stdout: | (launched: 2022-12-10_16:05:24.811396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:26.336239 run osmo-stp_10.42.42.5(pid=22305): stderr: | [0;m[38;5;43m20221210160525003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160525003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160525003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160525004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160525004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160525004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160525004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:26.471242 run osmo-stp_10.42.42.5(pid=22305): stdout: | (launched: 2022-12-10_16:05:24.811396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:26.599296 run osmo-stp_10.42.42.5(pid=22305): stderr: | [0;m[38;5;43m20221210160525003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160525003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160525003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160525004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160525004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160525004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160525004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:26.751776 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22305): Process ended prematurely: osmo-stp_10.42.42.5(pid=22305) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22305)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:05:26.761354 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:05:26.788752 run osmo-hlr_10.42.42.2(pid=22302): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22302)] 16:05:26.838700 run osmo-hlr_10.42.42.2(pid=22302): stdout: | (launched: 2022-12-10_16:05:23.817734) 16:05:26.890015 run osmo-hlr_10.42.42.2(pid=22302): stderr: | [0;m[1;31m20221210160524017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160524017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160524017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160524017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160524017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160524017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160524029 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160524038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160524038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160524038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:26.961511 run osmo-msc_10.42.42.6(pid=22308): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22308)] 16:05:27.011097 run osmo-msc_10.42.42.6(pid=22308): stdout: | (launched: 2022-12-10_16:05:25.830746) 16:05:27.062183 run osmo-msc_10.42.42.6(pid=22308): stderr: | [0;m[38;5;43m20221210160526151 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160526151 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbb2f59ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160526151 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160526152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160526152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160526152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160526154 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160526154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160526154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160526154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:27.113760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22301): Terminating (SIGTERM) 16:05:27.155122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22304): Terminating (SIGTERM) 16:05:27.196594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22307): Terminating (SIGTERM) 16:05:27.238393 --- ParallelTerminationStrategy: PID 22301 died... 16:05:27.258215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22301): Terminated: ok {rc=0} 16:05:27.304222 --- ParallelTerminationStrategy: PID 22304 died... 16:05:27.323630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22304): Terminated: ok {rc=0} 16:05:27.369717 --- ParallelTerminationStrategy: PID 22307 died... 16:05:27.389087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22307): Terminated: ok {rc=0} 16:05:27.476284 bus /sierra_3: Setting Powered False 16:05:28.574714 bus /sierra_3: Setting Powered False 16:05:29.689537 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:05:30.944171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:05:30.956320 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:05:31.000561 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:05:31.029991 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:05:31.084879 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:05:31.147799 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:05:31.184054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:05:31.730690 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:05:31.797537 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:31.815602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:05:31.921911 tst mo_mt_call.py: using LAC 29081 16:05:32.048649 tst mo_mt_call.py: using RAC 11 16:05:32.195786 tst mo_mt_call.py: using CellId 29081 16:05:32.335200 tst mo_mt_call.py: using BVCI 29082 16:05:32.452805 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:32.464688 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:32.476453 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:32.488051 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:32.499705 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:32.511301 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:05:32.630895 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:05:32.747492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:33.241815 run create_hlr_db(pid=22313): Launched 16:05:33.372568 bus /sierra_2: Setting Powered False 16:05:34.436420 run create_hlr_db(pid=22313): Terminated: ok {rc=0} 16:05:34.883060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22315): Launched 16:05:35.203030 run osmo-hlr_10.42.42.2(pid=22316): Launched 16:05:35.324142 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:35.878972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22318): Launched 16:05:36.199396 run osmo-stp_10.42.42.5(pid=22319): Launched 16:05:36.320467 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:36.904654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22321): Launched 16:05:37.225480 run osmo-msc_10.42.42.6(pid=22322): Launched 16:05:37.404414 run osmo-stp_10.42.42.5(pid=22319): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22319)] 16:05:37.541545 run osmo-stp_10.42.42.5(pid=22319): stdout: | (launched: 2022-12-10_16:05:36.140297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:37.677266 run osmo-stp_10.42.42.5(pid=22319): stderr: | [0;m[38;5;43m20221210160536333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160536333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160536333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160536334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160536334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160536334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160536334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:37.812642 run osmo-stp_10.42.42.5(pid=22319): stdout: | (launched: 2022-12-10_16:05:36.140297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:37.940854 run osmo-stp_10.42.42.5(pid=22319): stderr: | [0;m[38;5;43m20221210160536333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160536333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160536333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160536334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160536334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160536334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160536334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:38.094672 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22319): Process ended prematurely: osmo-stp_10.42.42.5(pid=22319) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22319)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:05:38.104484 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:05:38.132269 run osmo-hlr_10.42.42.2(pid=22316): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22316)] 16:05:38.182229 run osmo-hlr_10.42.42.2(pid=22316): stdout: | (launched: 2022-12-10_16:05:35.144180) 16:05:38.234687 run osmo-hlr_10.42.42.2(pid=22316): stderr: | [0;m[1;31m20221210160535343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160535343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160535343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160535343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160535343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160535343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160535356 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160535366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160535366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160535366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:38.306894 run osmo-msc_10.42.42.6(pid=22322): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22322)] 16:05:38.356752 run osmo-msc_10.42.42.6(pid=22322): stdout: | (launched: 2022-12-10_16:05:37.166558) 16:05:38.408487 run osmo-msc_10.42.42.6(pid=22322): stderr: | [0;m[38;5;43m20221210160537488 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160537488 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc5aff0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160537488 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160537488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160537488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160537489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160537490 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160537490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160537491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160537491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:38.460791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22315): Terminating (SIGTERM) 16:05:38.502877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22318): Terminating (SIGTERM) 16:05:38.544739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22321): Terminating (SIGTERM) 16:05:38.586817 --- ParallelTerminationStrategy: PID 22315 died... 16:05:38.606763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22315): Terminated: ok {rc=0} 16:05:38.653526 --- ParallelTerminationStrategy: PID 22318 died... 16:05:38.673151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22318): Terminated: ok {rc=0} 16:05:38.719127 --- ParallelTerminationStrategy: PID 22321 died... 16:05:38.739000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22321): Terminated: ok {rc=0} 16:05:38.826513 bus /sierra_3: Setting Powered False 16:05:39.924821 bus /sierra_3: Setting Powered False 16:05:41.041445 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:05:42.187942 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:42.200137 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:05:42.270566 tst mo_mt_call_osmux.py: using LAC 29082 16:05:42.389692 tst mo_mt_call_osmux.py: using RAC 12 16:05:42.507447 tst mo_mt_call_osmux.py: using CellId 29082 16:05:42.626909 tst mo_mt_call_osmux.py: using BVCI 29083 16:05:42.738209 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:42.749684 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:42.760767 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:42.772321 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:42.783835 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:42.795247 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:05:42.912415 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:05:43.029361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:43.495769 run create_hlr_db(pid=22324): Launched 16:05:43.610175 bus /sierra_2: Setting Powered False 16:05:44.670599 run create_hlr_db(pid=22324): Terminated: ok {rc=0} 16:05:45.108432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22326): Launched 16:05:45.428579 run osmo-hlr_10.42.42.2(pid=22327): Launched 16:05:45.550719 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:46.132049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22329): Launched 16:05:46.452926 run osmo-stp_10.42.42.5(pid=22330): Launched 16:05:46.725356 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:47.446541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22332): Launched 16:05:47.749419 run osmo-msc_10.42.42.6(pid=22333): Launched 16:05:47.918190 run osmo-stp_10.42.42.5(pid=22330): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22330)] 16:05:48.046444 run osmo-stp_10.42.42.5(pid=22330): stdout: | (launched: 2022-12-10_16:05:46.389253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:48.175590 run osmo-stp_10.42.42.5(pid=22330): stderr: | [0;m[38;5;43m20221210160546765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160546765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160546766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160546766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160546766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160546766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160546767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:48.301888 run osmo-stp_10.42.42.5(pid=22330): stdout: | (launched: 2022-12-10_16:05:46.389253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:48.422852 run osmo-stp_10.42.42.5(pid=22330): stderr: | [0;m[38;5;43m20221210160546765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160546765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160546766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160546766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160546766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160546766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160546767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:48.567603 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22330): Process ended prematurely: osmo-stp_10.42.42.5(pid=22330) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22330)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:05:48.576465 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:05:48.603629 run osmo-hlr_10.42.42.2(pid=22327): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22327)] 16:05:48.651463 run osmo-hlr_10.42.42.2(pid=22327): stdout: | (launched: 2022-12-10_16:05:45.370421) 16:05:48.701230 run osmo-hlr_10.42.42.2(pid=22327): stderr: | [0;m[1;31m20221210160545568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160545568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160545568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160545568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160545568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160545568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160545583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160545594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160545594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160545594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:48.770159 run osmo-msc_10.42.42.6(pid=22333): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22333)] 16:05:48.817809 run osmo-msc_10.42.42.6(pid=22333): stdout: | (launched: 2022-12-10_16:05:47.693916) 16:05:48.866966 run osmo-msc_10.42.42.6(pid=22333): stderr: | [0;m[38;5;43m20221210160547966 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160547966 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3eb5044c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160547966 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160547966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160547966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160547966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160547969 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160547969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160547969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160547969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:48.916634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22326): Terminating (SIGTERM) 16:05:48.956169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22329): Terminating (SIGTERM) 16:05:48.995978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22332): Terminating (SIGTERM) 16:05:49.035762 --- ParallelTerminationStrategy: PID 22326 died... 16:05:49.054851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22326): Terminated: ok {rc=0} 16:05:49.099262 --- ParallelTerminationStrategy: PID 22329 died... 16:05:49.117800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22329): Terminated: ok {rc=0} 16:05:49.161924 --- ParallelTerminationStrategy: PID 22332 died... 16:05:49.180583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22332): Terminated: ok {rc=0} 16:05:49.264446 bus /sierra_3: Setting Powered False 16:05:50.362259 bus /sierra_3: Setting Powered False 16:05:51.476922 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:05:52.729976 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:05:52.736583 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:05:52.771075 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:05:52.797570 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:05:52.851296 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:05:52.885506 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:05:52.911723 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:05:53.460792 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:05:53.509224 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:53.520395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:05:53.589361 tst mo_mt_call.py: using LAC 29083 16:05:53.708271 tst mo_mt_call.py: using RAC 13 16:05:53.827531 tst mo_mt_call.py: using CellId 29083 16:05:53.947586 tst mo_mt_call.py: using BVCI 29084 16:05:54.064721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:54.076700 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:54.088385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:54.100146 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:54.111946 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:54.123629 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:05:54.241573 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:05:54.358180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:54.857079 run create_hlr_db(pid=22338): Launched 16:05:54.987417 bus /sierra_2: Setting Powered False 16:05:56.051341 run create_hlr_db(pid=22338): Terminated: ok {rc=0} 16:05:56.498181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22340): Launched 16:05:56.819697 run osmo-hlr_10.42.42.2(pid=22341): Launched 16:05:56.941648 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:57.493088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22343): Launched 16:05:57.815134 run osmo-stp_10.42.42.5(pid=22344): Launched 16:05:57.936805 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:58.517836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22346): Launched 16:05:58.840221 run osmo-msc_10.42.42.6(pid=22347): Launched 16:05:59.018656 run osmo-stp_10.42.42.5(pid=22344): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22344)] 16:05:59.154399 run osmo-stp_10.42.42.5(pid=22344): stdout: | (launched: 2022-12-10_16:05:57.756549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:59.290164 run osmo-stp_10.42.42.5(pid=22344): stderr: | [0;m[38;5;43m20221210160557948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160557948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160557948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160557948 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160557951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160557951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160557951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:59.425744 run osmo-stp_10.42.42.5(pid=22344): stdout: | (launched: 2022-12-10_16:05:57.756549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:59.554939 run osmo-stp_10.42.42.5(pid=22344): stderr: | [0;m[38;5;43m20221210160557948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160557948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160557948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160557948 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160557951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160557951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160557951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:59.708808 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22344): Process ended prematurely: osmo-stp_10.42.42.5(pid=22344) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22344)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:05:59.718391 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:05:59.745985 run osmo-hlr_10.42.42.2(pid=22341): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22341)] 16:05:59.796032 run osmo-hlr_10.42.42.2(pid=22341): stdout: | (launched: 2022-12-10_16:05:56.761083) 16:05:59.847677 run osmo-hlr_10.42.42.2(pid=22341): stderr: | [0;m[1;31m20221210160556960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160556960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160556960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160556960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160556960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160556960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160556977 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160556986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160556987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160556987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:59.919369 run osmo-msc_10.42.42.6(pid=22347): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22347)] 16:05:59.969183 run osmo-msc_10.42.42.6(pid=22347): stdout: | (launched: 2022-12-10_16:05:58.781341) 16:06:00.020509 run osmo-msc_10.42.42.6(pid=22347): stderr: | [0;m[38;5;43m20221210160559105 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160559106 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f47ab293c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160559106 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160559106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160559106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160559106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160559108 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160559108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160559108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160559108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:00.072216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22340): Terminating (SIGTERM) 16:06:00.113824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22343): Terminating (SIGTERM) 16:06:00.155410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22346): Terminating (SIGTERM) 16:06:00.197341 --- ParallelTerminationStrategy: PID 22340 died... 16:06:00.217335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22340): Terminated: ok {rc=0} 16:06:00.263824 --- ParallelTerminationStrategy: PID 22343 died... 16:06:00.283440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22343): Terminated: ok {rc=0} 16:06:00.329619 --- ParallelTerminationStrategy: PID 22346 died... 16:06:00.349231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22346): Terminated: ok {rc=0} 16:06:00.437091 bus /sierra_3: Setting Powered False 16:06:01.533201 bus /sierra_3: Setting Powered False 16:06:02.651196 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:06:03.797022 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:03.809089 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:06:03.879049 tst mo_mt_call_osmux.py: using LAC 29084 16:06:03.996462 tst mo_mt_call_osmux.py: using RAC 14 16:06:04.117926 tst mo_mt_call_osmux.py: using CellId 29084 16:06:04.236035 tst mo_mt_call_osmux.py: using BVCI 29085 16:06:04.345548 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:04.356624 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:04.367594 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:04.378895 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:04.390340 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:04.401595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:06:04.516245 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:06:04.636289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:05.135906 run create_hlr_db(pid=22349): Launched 16:06:05.266174 bus /sierra_2: Setting Powered False 16:06:06.330172 run create_hlr_db(pid=22349): Terminated: ok {rc=0} 16:06:06.762915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22351): Launched 16:06:07.065551 run osmo-hlr_10.42.42.2(pid=22352): Launched 16:06:07.181208 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:07.716074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22354): Launched 16:06:08.017579 run osmo-stp_10.42.42.5(pid=22355): Launched 16:06:08.132181 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:08.678404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22357): Launched 16:06:08.980476 run osmo-msc_10.42.42.6(pid=22358): Launched 16:06:09.149130 run osmo-stp_10.42.42.5(pid=22355): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22355)] 16:06:09.277454 run osmo-stp_10.42.42.5(pid=22355): stdout: | (launched: 2022-12-10_16:06:07.961903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:09.406198 run osmo-stp_10.42.42.5(pid=22355): stderr: | [0;m[38;5;43m20221210160608132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160608132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160608133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160608133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160608133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160608134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160608134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:09.532442 run osmo-stp_10.42.42.5(pid=22355): stdout: | (launched: 2022-12-10_16:06:07.961903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:09.652793 run osmo-stp_10.42.42.5(pid=22355): stderr: | [0;m[38;5;43m20221210160608132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160608132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160608133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160608133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160608133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160608134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160608134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:09.797096 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22355): Process ended prematurely: osmo-stp_10.42.42.5(pid=22355) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22355)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:06:09.806083 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:06:09.832505 run osmo-hlr_10.42.42.2(pid=22352): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22352)] 16:06:09.880624 run osmo-hlr_10.42.42.2(pid=22352): stdout: | (launched: 2022-12-10_16:06:07.010348) 16:06:09.930320 run osmo-hlr_10.42.42.2(pid=22352): stderr: | [0;m[1;31m20221210160607187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160607187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160607187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160607187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160607187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160607187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160607198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160607207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160607207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160607207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:09.999255 run osmo-msc_10.42.42.6(pid=22358): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22358)] 16:06:10.046862 run osmo-msc_10.42.42.6(pid=22358): stdout: | (launched: 2022-12-10_16:06:08.925059) 16:06:10.096066 run osmo-msc_10.42.42.6(pid=22358): stderr: | [0;m[38;5;43m20221210160609198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160609198 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f40b1388c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160609198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160609198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160609198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160609199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160609200 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160609201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160609201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160609201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:10.145850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22351): Terminating (SIGTERM) 16:06:10.185426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22354): Terminating (SIGTERM) 16:06:10.225713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22357): Terminating (SIGTERM) 16:06:10.265739 --- ParallelTerminationStrategy: PID 22351 died... 16:06:10.284493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22351): Terminated: ok {rc=0} 16:06:10.328898 --- ParallelTerminationStrategy: PID 22354 died... 16:06:10.347538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22354): Terminated: ok {rc=0} 16:06:10.392151 --- ParallelTerminationStrategy: PID 22357 died... 16:06:10.410749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22357): Terminated: ok {rc=0} 16:06:10.494190 bus /sierra_3: Setting Powered False 16:06:11.591642 bus /sierra_3: Setting Powered False 16:06:12.706759 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:06:13.962922 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:13.970380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:06:14.005423 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:06:14.032838 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:06:14.086833 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:06:14.121436 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:06:14.148498 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:06:14.704525 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:06:14.755851 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:14.767523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:06:14.838845 tst mo_mt_call.py: using LAC 29085 16:06:14.965117 tst mo_mt_call.py: using RAC 15 16:06:15.092456 tst mo_mt_call.py: using CellId 29085 16:06:15.221444 tst mo_mt_call.py: using BVCI 29086 16:06:15.338878 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:15.350628 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:15.362178 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:15.373693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:15.385316 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:15.396767 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:06:15.516046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:06:15.634496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:16.154005 run create_hlr_db(pid=22364): Launched 16:06:16.318166 bus /sierra_2: Setting Powered False 16:06:17.381365 run create_hlr_db(pid=22364): Terminated: ok {rc=0} 16:06:17.811526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22366): Launched 16:06:18.113370 run osmo-hlr_10.42.42.2(pid=22367): Launched 16:06:18.228886 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:18.750957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22369): Launched 16:06:19.051994 run osmo-stp_10.42.42.5(pid=22370): Launched 16:06:19.166712 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:19.711014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22372): Launched 16:06:20.012794 run osmo-msc_10.42.42.6(pid=22373): Launched 16:06:20.181357 run osmo-stp_10.42.42.5(pid=22370): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22370)] 16:06:20.309123 run osmo-stp_10.42.42.5(pid=22370): stdout: | (launched: 2022-12-10_16:06:18.996933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:20.438069 run osmo-stp_10.42.42.5(pid=22370): stderr: | [0;m[38;5;43m20221210160619165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160619166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160619166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160619166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160619167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160619167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160619167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:20.564571 run osmo-stp_10.42.42.5(pid=22370): stdout: | (launched: 2022-12-10_16:06:18.996933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:20.684880 run osmo-stp_10.42.42.5(pid=22370): stderr: | [0;m[38;5;43m20221210160619165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160619166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160619166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160619166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160619167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160619167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160619167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:20.828862 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22370): Process ended prematurely: osmo-stp_10.42.42.5(pid=22370) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22370)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:06:20.837917 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:06:20.864578 run osmo-hlr_10.42.42.2(pid=22367): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22367)] 16:06:20.912481 run osmo-hlr_10.42.42.2(pid=22367): stdout: | (launched: 2022-12-10_16:06:18.057814) 16:06:20.962181 run osmo-hlr_10.42.42.2(pid=22367): stderr: | [0;m[1;31m20221210160618233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160618233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160618233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160618233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160618233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160618233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160618246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160618255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160618255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160618255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:21.031202 run osmo-msc_10.42.42.6(pid=22373): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22373)] 16:06:21.078767 run osmo-msc_10.42.42.6(pid=22373): stdout: | (launched: 2022-12-10_16:06:19.957326) 16:06:21.128144 run osmo-msc_10.42.42.6(pid=22373): stderr: | [0;m[38;5;43m20221210160620229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160620229 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efdbe76bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160620229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160620229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160620229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160620229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160620231 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160620231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160620232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160620232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:21.177815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22366): Terminating (SIGTERM) 16:06:21.217641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22369): Terminating (SIGTERM) 16:06:21.257704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22372): Terminating (SIGTERM) 16:06:21.297923 --- ParallelTerminationStrategy: PID 22366 died... 16:06:21.316881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22366): Terminated: ok {rc=0} 16:06:21.361501 --- ParallelTerminationStrategy: PID 22369 died... 16:06:21.379791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22369): Terminated: ok {rc=0} 16:06:21.423945 --- ParallelTerminationStrategy: PID 22372 died... 16:06:21.442433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22372): Terminated: ok {rc=0} 16:06:21.528141 bus /sierra_3: Setting Powered False 16:06:22.629276 bus /sierra_3: Setting Powered False 16:06:23.744759 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:06:24.892476 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:24.904931 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:06:24.981091 tst mo_mt_call_osmux.py: using LAC 29086 16:06:25.107402 tst mo_mt_call_osmux.py: using RAC 16 16:06:25.231781 tst mo_mt_call_osmux.py: using CellId 29086 16:06:25.350084 tst mo_mt_call_osmux.py: using BVCI 29087 16:06:25.459717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:25.471140 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:25.482374 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:25.493947 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:25.505519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:25.516769 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:06:25.632064 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:06:25.751669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:26.248942 run create_hlr_db(pid=22375): Launched 16:06:26.379464 bus /sierra_2: Setting Powered False 16:06:27.443363 run create_hlr_db(pid=22375): Terminated: ok {rc=0} 16:06:27.891683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22377): Launched 16:06:28.212889 run osmo-hlr_10.42.42.2(pid=22378): Launched 16:06:28.334542 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:28.889704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22380): Launched 16:06:29.211284 run osmo-stp_10.42.42.5(pid=22381): Launched 16:06:29.334042 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:29.916211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22383): Launched 16:06:30.237511 run osmo-msc_10.42.42.6(pid=22384): Launched 16:06:30.416012 run osmo-stp_10.42.42.5(pid=22381): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22381)] 16:06:30.551611 run osmo-stp_10.42.42.5(pid=22381): stdout: | (launched: 2022-12-10_16:06:29.152645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:30.687795 run osmo-stp_10.42.42.5(pid=22381): stderr: | [0;m[38;5;43m20221210160629343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160629343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160629344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160629344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160629345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160629345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160629345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:30.823253 run osmo-stp_10.42.42.5(pid=22381): stdout: | (launched: 2022-12-10_16:06:29.152645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:30.977425 run osmo-stp_10.42.42.5(pid=22381): stderr: | [0;m[38;5;43m20221210160629343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160629343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160629344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160629344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160629345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160629345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160629345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:31.127020 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22381): Process ended prematurely: osmo-stp_10.42.42.5(pid=22381) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22381)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:06:31.136820 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:06:31.166667 run osmo-hlr_10.42.42.2(pid=22378): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22378)] 16:06:31.218390 run osmo-hlr_10.42.42.2(pid=22378): stdout: | (launched: 2022-12-10_16:06:28.154269) 16:06:31.270418 run osmo-hlr_10.42.42.2(pid=22378): stderr: | [0;m[1;31m20221210160628354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160628354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160628354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160628355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160628355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160628355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160628367 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160628376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160628376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160628376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:31.342203 run osmo-msc_10.42.42.6(pid=22384): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22384)] 16:06:31.392845 run osmo-msc_10.42.42.6(pid=22384): stdout: | (launched: 2022-12-10_16:06:30.178725) 16:06:31.445910 run osmo-msc_10.42.42.6(pid=22384): stderr: | [0;m[38;5;43m20221210160630503 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160630503 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9cb3a76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160630503 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160630503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160630503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160630503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160630505 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160630506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160630506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160630506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:31.500349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22377): Terminating (SIGTERM) 16:06:31.543704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22380): Terminating (SIGTERM) 16:06:31.588451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22383): Terminating (SIGTERM) 16:06:31.631900 --- ParallelTerminationStrategy: PID 22377 died... 16:06:31.652485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22377): Terminated: ok {rc=0} 16:06:31.699346 --- ParallelTerminationStrategy: PID 22380 died... 16:06:31.719351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22380): Terminated: ok {rc=0} 16:06:31.767638 --- ParallelTerminationStrategy: PID 22383 died... 16:06:31.787507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22383): Terminated: ok {rc=0} 16:06:31.877546 bus /sierra_3: Setting Powered False 16:06:32.978265 bus /sierra_3: Setting Powered False 16:06:34.093109 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:06:35.348679 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:35.355533 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:06:35.390003 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:06:35.417437 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:06:35.471509 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:06:35.506402 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:06:35.533892 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:06:36.085449 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:06:36.136579 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:36.148264 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:06:36.220223 tst mo_mt_call.py: using LAC 29087 16:06:36.347102 tst mo_mt_call.py: using RAC 17 16:06:36.472563 tst mo_mt_call.py: using CellId 29087 16:06:36.597902 tst mo_mt_call.py: using BVCI 29088 16:06:36.714316 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:36.725964 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:36.737385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:36.748872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:36.760443 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:36.771889 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:06:36.886544 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:06:37.005177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:37.502966 run create_hlr_db(pid=22390): Launched 16:06:37.633645 bus /sierra_2: Setting Powered False 16:06:38.697949 run create_hlr_db(pid=22390): Terminated: ok {rc=0} 16:06:39.129685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22392): Launched 16:06:39.432345 run osmo-hlr_10.42.42.2(pid=22393): Launched 16:06:39.547461 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:40.067087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22395): Launched 16:06:40.368045 run osmo-stp_10.42.42.5(pid=22396): Launched 16:06:40.482192 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:41.028167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22398): Launched 16:06:41.331737 run osmo-msc_10.42.42.6(pid=22399): Launched 16:06:41.500239 run osmo-stp_10.42.42.5(pid=22396): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22396)] 16:06:41.628893 run osmo-stp_10.42.42.5(pid=22396): stdout: | (launched: 2022-12-10_16:06:40.312885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:41.757487 run osmo-stp_10.42.42.5(pid=22396): stderr: | [0;m[38;5;43m20221210160640486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160640486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160640486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160640486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160640487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160640487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160640487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:41.883534 run osmo-stp_10.42.42.5(pid=22396): stdout: | (launched: 2022-12-10_16:06:40.312885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:42.003792 run osmo-stp_10.42.42.5(pid=22396): stderr: | [0;m[38;5;43m20221210160640486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160640486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160640486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160640486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160640487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160640487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160640487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:42.148050 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22396): Process ended prematurely: osmo-stp_10.42.42.5(pid=22396) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22396)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:06:42.156939 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:06:42.183585 run osmo-hlr_10.42.42.2(pid=22393): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22393)] 16:06:42.231389 run osmo-hlr_10.42.42.2(pid=22393): stdout: | (launched: 2022-12-10_16:06:39.376910) 16:06:42.281335 run osmo-hlr_10.42.42.2(pid=22393): stderr: | [0;m[1;31m20221210160639556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160639556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160639556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160639556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160639556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160639556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160639573 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160639583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160639583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160639583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:42.350034 run osmo-msc_10.42.42.6(pid=22399): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22399)] 16:06:42.397748 run osmo-msc_10.42.42.6(pid=22399): stdout: | (launched: 2022-12-10_16:06:41.275975) 16:06:42.446887 run osmo-msc_10.42.42.6(pid=22399): stderr: | [0;m[38;5;43m20221210160641548 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160641548 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f69ee642c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160641548 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160641548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160641548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160641549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160641550 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160641551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160641551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160641551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:42.496294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22392): Terminating (SIGTERM) 16:06:42.535939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22395): Terminating (SIGTERM) 16:06:42.575644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22398): Terminating (SIGTERM) 16:06:42.615722 --- ParallelTerminationStrategy: PID 22392 died... 16:06:42.634804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22392): Terminated: ok {rc=0} 16:06:42.679269 --- ParallelTerminationStrategy: PID 22395 died... 16:06:42.697845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22395): Terminated: ok {rc=0} 16:06:42.742428 --- ParallelTerminationStrategy: PID 22398 died... 16:06:42.760824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22398): Terminated: ok {rc=0} 16:06:42.847419 bus /sierra_3: Setting Powered False 16:06:43.945953 bus /sierra_3: Setting Powered False 16:06:45.059429 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:06:46.227981 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:46.245142 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:06:46.333235 tst mo_mt_call_osmux.py: using LAC 29088 16:06:46.480510 tst mo_mt_call_osmux.py: using RAC 18 16:06:46.610345 tst mo_mt_call_osmux.py: using CellId 29088 16:06:46.733242 tst mo_mt_call_osmux.py: using BVCI 29089 16:06:46.846096 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:46.858673 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:46.870974 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:46.885288 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:46.898735 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:46.912131 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:06:47.032075 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:06:47.157955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:47.662081 run create_hlr_db(pid=22401): Launched 16:06:47.793750 bus /sierra_2: Setting Powered False 16:06:48.857776 run create_hlr_db(pid=22401): Terminated: ok {rc=0} 16:06:49.307525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22403): Launched 16:06:49.630868 run osmo-hlr_10.42.42.2(pid=22404): Launched 16:06:49.754201 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:50.306322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22406): Launched 16:06:50.628620 run osmo-stp_10.42.42.5(pid=22407): Launched 16:06:50.752351 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:51.334042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22409): Launched 16:06:51.656928 run osmo-msc_10.42.42.6(pid=22410): Launched 16:06:51.835907 run osmo-stp_10.42.42.5(pid=22407): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22407)] 16:06:51.971283 run osmo-stp_10.42.42.5(pid=22407): stdout: | (launched: 2022-12-10_16:06:50.569969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:52.107070 run osmo-stp_10.42.42.5(pid=22407): stderr: | [0;m[38;5;43m20221210160650762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160650762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160650762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160650763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160650763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160650763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160650763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:52.242648 run osmo-stp_10.42.42.5(pid=22407): stdout: | (launched: 2022-12-10_16:06:50.569969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:52.371209 run osmo-stp_10.42.42.5(pid=22407): stderr: | [0;m[38;5;43m20221210160650762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160650762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160650762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160650763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160650763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160650763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160650763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:52.525540 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22407): Process ended prematurely: osmo-stp_10.42.42.5(pid=22407) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22407)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:06:52.534949 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:06:52.562648 run osmo-hlr_10.42.42.2(pid=22404): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22404)] 16:06:52.612570 run osmo-hlr_10.42.42.2(pid=22404): stdout: | (launched: 2022-12-10_16:06:49.572068) 16:06:52.664313 run osmo-hlr_10.42.42.2(pid=22404): stderr: | [0;m[1;31m20221210160649771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160649771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160649771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160649771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160649771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160649771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160649783 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160649791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160649792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160649792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:52.736275 run osmo-msc_10.42.42.6(pid=22410): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22410)] 16:06:52.785981 run osmo-msc_10.42.42.6(pid=22410): stdout: | (launched: 2022-12-10_16:06:51.597934) 16:06:52.837503 run osmo-msc_10.42.42.6(pid=22410): stderr: | [0;m[38;5;43m20221210160651922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160651922 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f68cd5bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160651922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160651922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160651922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160651923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160651924 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160651925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160651925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160651925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:52.889457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22403): Terminating (SIGTERM) 16:06:52.930822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22406): Terminating (SIGTERM) 16:06:52.972165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22409): Terminating (SIGTERM) 16:06:53.013761 --- ParallelTerminationStrategy: PID 22403 died... 16:06:53.033669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22403): Terminated: ok {rc=0} 16:06:53.079865 --- ParallelTerminationStrategy: PID 22406 died... 16:06:53.099396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22406): Terminated: ok {rc=0} 16:06:53.145236 --- ParallelTerminationStrategy: PID 22409 died... 16:06:53.164654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22409): Terminated: ok {rc=0} 16:06:53.252679 bus /sierra_3: Setting Powered False 16:06:54.351118 bus /sierra_3: Setting Powered False 16:06:55.466399 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:06:56.728066 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:56.735054 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:06:56.769578 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:06:56.797037 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:06:56.849970 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:06:56.884186 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:06:56.911280 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:06:57.467654 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:06:57.519336 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:57.531303 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:06:57.603821 tst mo_mt_call.py: using LAC 29089 16:06:57.735635 tst mo_mt_call.py: using RAC 19 16:06:57.861834 tst mo_mt_call.py: using CellId 29089 16:06:57.987967 tst mo_mt_call.py: using BVCI 29090 16:06:58.103810 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:58.116056 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:58.127663 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:58.139265 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:58.150923 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:58.162591 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:06:58.281367 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:06:58.397792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:58.864853 run create_hlr_db(pid=22416): Launched 16:06:58.981312 bus /sierra_2: Setting Powered False 16:07:00.041803 run create_hlr_db(pid=22416): Terminated: ok {rc=0} 16:07:00.482206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22418): Launched 16:07:00.803690 run osmo-hlr_10.42.42.2(pid=22419): Launched 16:07:00.981804 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:01.829683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22421): Launched 16:07:02.165698 run osmo-stp_10.42.42.5(pid=22422): Launched 16:07:02.355804 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:02.942153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22424): Launched 16:07:03.263274 run osmo-msc_10.42.42.6(pid=22425): Launched 16:07:03.442266 run osmo-stp_10.42.42.5(pid=22422): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22422)] 16:07:03.577784 run osmo-stp_10.42.42.5(pid=22422): stdout: | (launched: 2022-12-10_16:07:02.101217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:03.713727 run osmo-stp_10.42.42.5(pid=22422): stderr: | [0;m[38;5;43m20221210160702374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160702375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160702375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160702375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160702376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160702376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160702376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:03.848510 run osmo-stp_10.42.42.5(pid=22422): stdout: | (launched: 2022-12-10_16:07:02.101217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:03.976713 run osmo-stp_10.42.42.5(pid=22422): stderr: | [0;m[38;5;43m20221210160702374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160702375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160702375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160702375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160702376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160702376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160702376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:04.130061 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22422): Process ended prematurely: osmo-stp_10.42.42.5(pid=22422) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22422)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:07:04.139535 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 16:07:04.167205 run osmo-hlr_10.42.42.2(pid=22419): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22419)] 16:07:04.217185 run osmo-hlr_10.42.42.2(pid=22419): stdout: | (launched: 2022-12-10_16:07:00.745300) 16:07:04.268500 run osmo-hlr_10.42.42.2(pid=22419): stderr: | [0;m[1;31m20221210160701078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160701078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160701078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160701078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160701078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160701078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160701096 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160701119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160701119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160701119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:04.340395 run osmo-msc_10.42.42.6(pid=22425): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22425)] 16:07:04.389961 run osmo-msc_10.42.42.6(pid=22425): stdout: | (launched: 2022-12-10_16:07:03.204460) 16:07:04.441629 run osmo-msc_10.42.42.6(pid=22425): stderr: | [0;m[38;5;43m20221210160703527 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160703527 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6cc94a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160703528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160703528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160703528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160703528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160703530 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160703530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160703530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160703530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:04.493697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22418): Terminating (SIGTERM) 16:07:04.535220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22421): Terminating (SIGTERM) 16:07:04.576609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22424): Terminating (SIGTERM) 16:07:04.618296 --- ParallelTerminationStrategy: PID 22418 died... 16:07:04.638008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22418): Terminated: ok {rc=0} 16:07:04.684174 --- ParallelTerminationStrategy: PID 22421 died... 16:07:04.703534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22421): Terminated: ok {rc=0} 16:07:04.749157 --- ParallelTerminationStrategy: PID 22424 died... 16:07:04.768398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22424): Terminated: ok {rc=0} 16:07:04.855420 bus /sierra_3: Setting Powered False 16:07:05.954625 bus /sierra_3: Setting Powered False 16:07:07.070217 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:07:08.218477 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:08.230970 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:07:08.305356 tst mo_mt_call_osmux.py: using LAC 29090 16:07:08.432791 tst mo_mt_call_osmux.py: using RAC 20 16:07:08.559312 tst mo_mt_call_osmux.py: using CellId 29090 16:07:08.684848 tst mo_mt_call_osmux.py: using BVCI 29091 16:07:08.803319 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:08.815160 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:08.826731 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:08.838915 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:08.851383 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:08.863645 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:07:08.982352 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:07:09.101546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:09.600707 run create_hlr_db(pid=22427): Launched 16:07:09.731423 bus /sierra_2: Setting Powered False 16:07:10.794872 run create_hlr_db(pid=22427): Terminated: ok {rc=0} 16:07:11.226019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22429): Launched 16:07:11.528149 run osmo-hlr_10.42.42.2(pid=22430): Launched 16:07:11.642862 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:12.178708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22432): Launched 16:07:12.478919 run osmo-stp_10.42.42.5(pid=22433): Launched 16:07:12.594174 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:13.140352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22435): Launched 16:07:13.442947 run osmo-msc_10.42.42.6(pid=22436): Launched 16:07:13.612293 run osmo-stp_10.42.42.5(pid=22433): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22433)] 16:07:13.744519 run osmo-stp_10.42.42.5(pid=22433): stdout: | (launched: 2022-12-10_16:07:12.423715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:13.872668 run osmo-stp_10.42.42.5(pid=22433): stderr: | [0;m[38;5;43m20221210160712593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160712593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160712593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160712594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160712596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160712596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160712596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:13.998781 run osmo-stp_10.42.42.5(pid=22433): stdout: | (launched: 2022-12-10_16:07:12.423715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:14.119691 run osmo-stp_10.42.42.5(pid=22433): stderr: | [0;m[38;5;43m20221210160712593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160712593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160712593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160712594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160712596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160712596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160712596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:14.263970 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22433): Process ended prematurely: osmo-stp_10.42.42.5(pid=22433) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22433)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:07:14.272938 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:07:14.299790 run osmo-hlr_10.42.42.2(pid=22430): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22430)] 16:07:14.347357 run osmo-hlr_10.42.42.2(pid=22430): stdout: | (launched: 2022-12-10_16:07:11.472420) 16:07:14.396772 run osmo-hlr_10.42.42.2(pid=22430): stderr: | [0;m[1;31m20221210160711649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160711649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160711649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160711649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160711649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160711649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160711662 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160711671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160711671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160711671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:14.465479 run osmo-msc_10.42.42.6(pid=22436): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22436)] 16:07:14.513144 run osmo-msc_10.42.42.6(pid=22436): stdout: | (launched: 2022-12-10_16:07:13.387450) 16:07:14.562491 run osmo-msc_10.42.42.6(pid=22436): stderr: | [0;m[38;5;43m20221210160713660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160713661 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c919a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160713661 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160713661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160713661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160713661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160713663 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160713664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160713664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160713664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:14.612555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22429): Terminating (SIGTERM) 16:07:14.652557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22432): Terminating (SIGTERM) 16:07:14.698062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22435): Terminating (SIGTERM) 16:07:14.740203 --- ParallelTerminationStrategy: PID 22429 died... 16:07:14.760096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22429): Terminated: ok {rc=0} 16:07:14.807349 --- ParallelTerminationStrategy: PID 22432 died... 16:07:14.827232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22432): Terminated: ok {rc=0} 16:07:14.873262 --- ParallelTerminationStrategy: PID 22435 died... 16:07:14.892602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22435): Terminated: ok {rc=0} 16:07:14.979924 bus /sierra_3: Setting Powered False 16:07:16.077247 bus /sierra_3: Setting Powered False 16:07:17.197417 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:07:18.455130 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:07:18.460741 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:07:18.494886 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:07:18.521493 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:07:18.571189 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:07:18.604588 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:07:18.631285 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:07:19.182811 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:07:19.231494 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:19.242537 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:07:19.310810 tst mo_mt_call.py: using LAC 29091 16:07:19.429247 tst mo_mt_call.py: using RAC 21 16:07:19.545685 tst mo_mt_call.py: using CellId 29091 16:07:19.662414 tst mo_mt_call.py: using BVCI 29092 16:07:19.771357 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:19.782375 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:19.793166 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:19.804229 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:19.815398 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:19.826533 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:07:19.944073 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:07:20.063550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:20.564258 run create_hlr_db(pid=22441): Launched 16:07:20.695859 bus /sierra_2: Setting Powered False 16:07:21.760426 run create_hlr_db(pid=22441): Terminated: ok {rc=0} 16:07:22.192462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22443): Launched 16:07:22.516083 run osmo-hlr_10.42.42.2(pid=22444): Launched 16:07:22.638985 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:23.192924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22446): Launched 16:07:23.515983 run osmo-stp_10.42.42.5(pid=22447): Launched 16:07:23.638827 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:24.220587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22449): Launched 16:07:24.542092 run osmo-msc_10.42.42.6(pid=22450): Launched 16:07:24.720811 run osmo-stp_10.42.42.5(pid=22447): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22447)] 16:07:24.855825 run osmo-stp_10.42.42.5(pid=22447): stdout: | (launched: 2022-12-10_16:07:23.456525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:24.991708 run osmo-stp_10.42.42.5(pid=22447): stderr: | [0;m[38;5;43m20221210160723649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160723649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160723650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160723650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160723650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160723651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160723651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:25.126631 run osmo-stp_10.42.42.5(pid=22447): stdout: | (launched: 2022-12-10_16:07:23.456525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:25.255290 run osmo-stp_10.42.42.5(pid=22447): stderr: | [0;m[38;5;43m20221210160723649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160723649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160723650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160723650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160723650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160723651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160723651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:25.408490 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22447): Process ended prematurely: osmo-stp_10.42.42.5(pid=22447) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22447)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:07:25.418107 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:07:25.445852 run osmo-hlr_10.42.42.2(pid=22444): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22444)] 16:07:25.496880 run osmo-hlr_10.42.42.2(pid=22444): stdout: | (launched: 2022-12-10_16:07:22.457120) 16:07:25.548475 run osmo-hlr_10.42.42.2(pid=22444): stderr: | [0;m[1;31m20221210160722655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160722655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160722655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160722655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160722655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160722655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160722667 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160722675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160722675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160722675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:25.620408 run osmo-msc_10.42.42.6(pid=22450): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22450)] 16:07:25.670216 run osmo-msc_10.42.42.6(pid=22450): stdout: | (launched: 2022-12-10_16:07:24.483058) 16:07:25.721681 run osmo-msc_10.42.42.6(pid=22450): stderr: | [0;m[38;5;43m20221210160724807 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160724807 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa084a5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160724807 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160724807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160724808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160724808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160724810 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160724810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160724810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160724810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:25.773703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22443): Terminating (SIGTERM) 16:07:25.815052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22446): Terminating (SIGTERM) 16:07:25.856466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22449): Terminating (SIGTERM) 16:07:25.898111 --- ParallelTerminationStrategy: PID 22443 died... 16:07:25.917903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22443): Terminated: ok {rc=0} 16:07:25.964003 --- ParallelTerminationStrategy: PID 22446 died... 16:07:25.983625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22446): Terminated: ok {rc=0} 16:07:26.030012 --- ParallelTerminationStrategy: PID 22449 died... 16:07:26.049676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22449): Terminated: ok {rc=0} 16:07:26.137580 bus /sierra_3: Setting Powered False 16:07:27.235886 bus /sierra_3: Setting Powered False 16:07:28.351043 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:07:29.499932 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:29.512360 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:07:29.592547 tst mo_mt_call_osmux.py: using LAC 29092 16:07:29.719906 tst mo_mt_call_osmux.py: using RAC 22 16:07:29.846452 tst mo_mt_call_osmux.py: using CellId 29092 16:07:29.970777 tst mo_mt_call_osmux.py: using BVCI 29093 16:07:30.087843 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:30.099419 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:30.110800 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:30.122201 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:30.133715 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:30.145000 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:07:30.259818 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:07:30.382795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:30.880687 run create_hlr_db(pid=22452): Launched 16:07:31.042840 bus /sierra_2: Setting Powered False 16:07:32.105360 run create_hlr_db(pid=22452): Terminated: ok {rc=0} 16:07:32.557364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22454): Launched 16:07:32.878294 run osmo-hlr_10.42.42.2(pid=22455): Launched 16:07:32.999169 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:33.555297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22457): Launched 16:07:33.876535 run osmo-stp_10.42.42.5(pid=22458): Launched 16:07:33.998751 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:34.579953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22460): Launched 16:07:34.901638 run osmo-msc_10.42.42.6(pid=22461): Launched 16:07:35.080701 run osmo-stp_10.42.42.5(pid=22458): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22458)] 16:07:35.216066 run osmo-stp_10.42.42.5(pid=22458): stdout: | (launched: 2022-12-10_16:07:33.817880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:35.352674 run osmo-stp_10.42.42.5(pid=22458): stderr: | [0;m[38;5;43m20221210160734009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160734009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160734009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160734010 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160734010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160734010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160734010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:35.488496 run osmo-stp_10.42.42.5(pid=22458): stdout: | (launched: 2022-12-10_16:07:33.817880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:35.618439 run osmo-stp_10.42.42.5(pid=22458): stderr: | [0;m[38;5;43m20221210160734009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160734009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160734009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160734010 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160734010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160734010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160734010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:35.772342 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22458): Process ended prematurely: osmo-stp_10.42.42.5(pid=22458) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22458)] [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:07:35.782054 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:07:35.809864 run osmo-hlr_10.42.42.2(pid=22455): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22455)] 16:07:35.859945 run osmo-hlr_10.42.42.2(pid=22455): stdout: | (launched: 2022-12-10_16:07:32.819673) 16:07:35.911804 run osmo-hlr_10.42.42.2(pid=22455): stderr: | [0;m[1;31m20221210160733017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160733017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160733017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160733017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160733017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160733017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160733032 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160733040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160733041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160733041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:35.984211 run osmo-msc_10.42.42.6(pid=22461): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22461)] 16:07:36.034361 run osmo-msc_10.42.42.6(pid=22461): stdout: | (launched: 2022-12-10_16:07:34.842899) 16:07:36.085930 run osmo-msc_10.42.42.6(pid=22461): stderr: | [0;m[38;5;43m20221210160735164 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160735165 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdcaf10ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160735165 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160735165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160735165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160735165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160735167 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160735167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160735167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160735167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:36.137662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22454): Terminating (SIGTERM) 16:07:36.179156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22457): Terminating (SIGTERM) 16:07:36.220897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22460): Terminating (SIGTERM) 16:07:36.262748 --- ParallelTerminationStrategy: PID 22454 died... 16:07:36.282260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22454): Terminated: ok {rc=0} 16:07:36.328508 --- ParallelTerminationStrategy: PID 22457 died... 16:07:36.348233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22457): Terminated: ok {rc=0} 16:07:36.394148 --- ParallelTerminationStrategy: PID 22460 died... 16:07:36.413613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22460): Terminated: ok {rc=0} 16:07:36.501600 bus /sierra_3: Setting Powered False 16:07:37.599982 bus /sierra_3: Setting Powered False 16:07:38.714412 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 16:07:39.969434 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:07:39.974101 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:07:40.008500 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:07:40.035873 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 16:07:40.122778 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:07:40.157245 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:07:40.184658 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 16:07:40.770044 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2376 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 16:07:40.775143 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:40.786463 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:07:40.841202 tst emergency_mo_mt_call.py: using LAC 29093 16:07:40.964830 tst emergency_mo_mt_call.py: using RAC 23 16:07:41.087123 tst emergency_mo_mt_call.py: using CellId 29093 16:07:41.207922 tst emergency_mo_mt_call.py: using BVCI 29094 16:07:41.323356 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:41.334975 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:41.346347 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:41.357690 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:41.368930 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:41.380257 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:41.496077 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:41.608271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:42.066943 run create_hlr_db(pid=22467): Launched 16:07:42.180431 bus /sierra_2: Setting Powered False 16:07:43.239383 run create_hlr_db(pid=22467): Terminated: ok {rc=0} 16:07:43.674500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22469): Launched 16:07:43.990027 run osmo-hlr_10.42.42.2(pid=22470): Launched 16:07:44.110302 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:44.654535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22472): Launched 16:07:44.970169 run osmo-stp_10.42.42.5(pid=22473): Launched 16:07:45.100791 tst emergency_mo_mt_call.py: using MSISDN 7788 16:07:45.264405 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:45.837044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22475): Launched 16:07:46.177851 run osmo-msc_10.42.42.6(pid=22476): Launched 16:07:46.420112 run osmo-stp_10.42.42.5(pid=22473): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22473)] 16:07:46.678546 run osmo-stp_10.42.42.5(pid=22473): stdout: | (launched: 2022-12-10_16:07:44.912236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:46.897851 run osmo-stp_10.42.42.5(pid=22473): stderr: | [0;m[38;5;43m20221210160745105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160745105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160745105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160745106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160745106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160745106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160745106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:47.069970 run osmo-stp_10.42.42.5(pid=22473): stdout: | (launched: 2022-12-10_16:07:44.912236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:47.199183 run osmo-stp_10.42.42.5(pid=22473): stderr: | [0;m[38;5;43m20221210160745105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160745105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160745105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160745106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160745106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160745106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160745106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:47.349532 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22473): Process ended prematurely: osmo-stp_10.42.42.5(pid=22473) [trial-2376↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22473)] [trial-2376↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 16:07:47.358663 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 16:07:47.386849 run osmo-hlr_10.42.42.2(pid=22470): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22470)] 16:07:47.436017 run osmo-hlr_10.42.42.2(pid=22470): stdout: | (launched: 2022-12-10_16:07:43.931876) 16:07:47.486980 run osmo-hlr_10.42.42.2(pid=22470): stderr: | [0;m[1;31m20221210160744131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160744131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160744131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160744131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160744131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160744131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160744144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160744154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160744154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160744154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:47.557603 run osmo-msc_10.42.42.6(pid=22476): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22476)] 16:07:47.606692 run osmo-msc_10.42.42.6(pid=22476): stdout: | (launched: 2022-12-10_16:07:46.114676) 16:07:47.657524 run osmo-msc_10.42.42.6(pid=22476): stderr: | [0;m[38;5;43m20221210160746657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160746657 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb06f56ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160746658 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160746658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160746658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160746658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160746660 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160746660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160746661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160746661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:47.708613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22469): Terminating (SIGTERM) 16:07:47.749702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22472): Terminating (SIGTERM) 16:07:47.791109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22475): Terminating (SIGTERM) 16:07:47.832657 --- ParallelTerminationStrategy: PID 22469 died... 16:07:47.851945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22469): Terminated: ok {rc=0} 16:07:47.898047 --- ParallelTerminationStrategy: PID 22472 died... 16:07:47.917106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22472): Terminated: ok {rc=0} 16:07:47.963219 --- ParallelTerminationStrategy: PID 22475 died... 16:07:47.982251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22475): Terminated: ok {rc=0} 16:07:48.070944 bus /sierra_3: Setting Powered False 16:07:49.170792 bus /sierra_3: Setting Powered False 16:07:50.284078 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 16:07:51.371150 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:51.383205 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:07:51.436663 tst emergency_preemptive_call.py: using LAC 29094 16:07:51.560848 tst emergency_preemptive_call.py: using RAC 24 16:07:51.684401 tst emergency_preemptive_call.py: using CellId 29094 16:07:51.800839 tst emergency_preemptive_call.py: using BVCI 29095 16:07:51.908023 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:51.919144 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:51.929978 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:51.941077 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:51.952304 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:51.963532 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:52.079916 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:52.198712 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:52.313575 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:52.426689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:52.889122 run create_hlr_db(pid=22478): Launched 16:07:53.002128 bus /sierra_2: Setting Powered False 16:07:54.061987 run create_hlr_db(pid=22478): Terminated: ok {rc=0} 16:07:54.498224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22480): Launched 16:07:54.816491 run osmo-hlr_10.42.42.2(pid=22481): Launched 16:07:54.936187 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:55.487204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22483): Launched 16:07:55.805096 run osmo-stp_10.42.42.5(pid=22484): Launched 16:07:55.936149 tst emergency_preemptive_call.py: using MSISDN 7789 16:07:56.098594 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:56.669098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22486): Launched 16:07:56.984666 run osmo-msc_10.42.42.6(pid=22487): Launched 16:07:57.160134 run osmo-stp_10.42.42.5(pid=22484): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22484)] 16:07:57.293872 run osmo-stp_10.42.42.5(pid=22484): stdout: | (launched: 2022-12-10_16:07:55.746907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:57.428140 run osmo-stp_10.42.42.5(pid=22484): stderr: | [0;m[38;5;43m20221210160755940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160755940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160755940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160755941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160755941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160755941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160755941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:57.563581 run osmo-stp_10.42.42.5(pid=22484): stdout: | (launched: 2022-12-10_16:07:55.746907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:57.690295 run osmo-stp_10.42.42.5(pid=22484): stderr: | [0;m[38;5;43m20221210160755940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160755940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160755940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160755941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160755941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160755941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160755941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:57.842005 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22484): Process ended prematurely: osmo-stp_10.42.42.5(pid=22484) [trial-2376↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22484)] [trial-2376↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 16:07:57.850889 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 16:07:57.878443 run osmo-hlr_10.42.42.2(pid=22481): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22481)] 16:07:57.928641 run osmo-hlr_10.42.42.2(pid=22481): stdout: | (launched: 2022-12-10_16:07:54.757952) 16:07:57.980772 run osmo-hlr_10.42.42.2(pid=22481): stderr: | [0;m[1;31m20221210160754956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160754956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160754956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160754956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160754957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160754957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160754970 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160754979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160754979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160754980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:58.053847 run osmo-msc_10.42.42.6(pid=22487): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22487)] 16:07:58.104178 run osmo-msc_10.42.42.6(pid=22487): stdout: | (launched: 2022-12-10_16:07:56.926731) 16:07:58.156218 run osmo-msc_10.42.42.6(pid=22487): stderr: | [0;m[38;5;43m20221210160757248 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210160757249 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fad6e209c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210160757249 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210160757249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210160757249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210160757249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210160757251 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210160757251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210160757252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210160757252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:58.208521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22480): Terminating (SIGTERM) 16:07:58.250346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22483): Terminating (SIGTERM) 16:07:58.292332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22486): Terminating (SIGTERM) 16:07:58.334403 --- ParallelTerminationStrategy: PID 22480 died... 16:07:58.354481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22480): Terminated: ok {rc=0} 16:07:58.400865 --- ParallelTerminationStrategy: PID 22483 died... 16:07:58.420911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22483): Terminated: ok {rc=0} 16:07:58.467093 --- ParallelTerminationStrategy: PID 22486 died... 16:07:58.486647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22486): Terminated: ok {rc=0} 16:07:58.574764 bus /sierra_9: Setting Powered False 16:07:59.672583 bus /sierra_9: Setting Powered False 16:08:00.788460 bus /sierra_8: Setting Powered False 16:08:01.896405 bus /sierra_8: Setting Powered False 16:08:03.012670 bus /sierra_3: Setting Powered False 16:08:04.111742 bus /sierra_3: Setting Powered False 16:08:05.237592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 16:08:06.524689 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:08:06.529426 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:08:06.563867 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 16:08:06.603109 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 16:08:06.691348 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:08:06.725659 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 16:08:06.764693 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 16:08:07.364314 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 16:08:07.418182 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:07.429360 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:08:07.478536 tst cs_paging_gprs_active.py: using LAC 29095 16:08:07.605660 tst cs_paging_gprs_active.py: using RAC 25 16:08:07.730340 tst cs_paging_gprs_active.py: using CellId 29095 16:08:07.855281 tst cs_paging_gprs_active.py: using BVCI 29096 16:08:07.973976 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:07.985238 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:07.996126 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:08.007168 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:08.018168 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:08.029118 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:08.040254 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:08.051180 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:08.062403 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:08.179600 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:08.297564 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:08:08.517739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:08.841596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22492): Launched 16:08:09.123060 run iperf3-srv_10.42.42.10(pid=22493): Launched 16:08:09.243791 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:08:09.462514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:09.787131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22494): Launched 16:08:10.069378 run iperf3-srv_10.42.42.10(pid=22495): Launched 16:08:10.190500 tst cs_paging_gprs_active.py:38: start network... 16:08:10.409460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:10.911314 run create_hlr_db(pid=22496): Launched 16:08:11.042313 bus /sierra_2: Setting Powered False 16:08:12.106177 run create_hlr_db(pid=22496): Terminated: ok {rc=0} 16:08:12.540676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22498): Launched 16:08:12.844873 run osmo-hlr_10.42.42.2(pid=22499): Launched 16:08:12.960767 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:13.498003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22501): Launched 16:08:13.801651 run osmo-stp_10.42.42.5(pid=22502): Launched 16:08:13.917689 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:08:14.454254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22504): Launched 16:08:14.570577 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:08:14.826759 run patchelf(pid=22505): Launched 16:08:14.995436 run osmo-stp_10.42.42.5(pid=22502): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22502)] 16:08:15.124189 run osmo-stp_10.42.42.5(pid=22502): stdout: | (launched: 2022-12-10_16:08:13.745525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:15.254867 run osmo-stp_10.42.42.5(pid=22502): stderr: | [0;m[38;5;43m20221210160813917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160813917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160813917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160813918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160813918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160813918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160813919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:15.385574 run osmo-stp_10.42.42.5(pid=22502): stdout: | (launched: 2022-12-10_16:08:13.745525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:15.509880 run osmo-stp_10.42.42.5(pid=22502): stderr: | [0;m[38;5;43m20221210160813917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160813917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160813917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160813918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160813918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160813918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160813919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:15.657473 run patchelf(pid=22505): Terminating (SIGINT) 16:08:15.829558 run patchelf(pid=22505): Terminated: ok {rc=0} 16:08:15.977201 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22502): Process ended prematurely: osmo-stp_10.42.42.5(pid=22502) [trial-2376↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22502)] [trial-2376↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 16:08:15.987855 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:08:16.019477 run osmo-hlr_10.42.42.2(pid=22499): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22499)] 16:08:16.070588 run osmo-hlr_10.42.42.2(pid=22499): stdout: | (launched: 2022-12-10_16:08:12.788757) 16:08:16.123475 run osmo-hlr_10.42.42.2(pid=22499): stderr: | [0;m[1;31m20221210160812966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160812967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160812967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160812967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160812967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160812967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160812979 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160812990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160812990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160812990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:16.177440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22492): Terminating (SIGTERM) 16:08:16.221039 run iperf3-srv_10.42.42.10(pid=22493): Terminating (SIGTERM) 16:08:16.266827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22494): Terminating (SIGTERM) 16:08:16.310760 run iperf3-srv_10.42.42.10(pid=22495): Terminating (SIGTERM) 16:08:16.357183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22498): Terminating (SIGTERM) 16:08:16.400343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22501): Terminating (SIGTERM) 16:08:16.443271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22504): Terminating (SIGTERM) 16:08:16.486594 --- ParallelTerminationStrategy: PID 22492 died... 16:08:16.506790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22492): Terminated: ok {rc=0} 16:08:16.563325 --- ParallelTerminationStrategy: PID 22493 died... 16:08:16.589421 run iperf3-srv_10.42.42.10(pid=22493): Terminated {rc=256} 16:08:16.663957 --- ParallelTerminationStrategy: PID 22494 died... 16:08:16.694191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22494): Terminated: ok {rc=0} 16:08:16.776421 --- ParallelTerminationStrategy: PID 22495 died... 16:08:16.809444 run iperf3-srv_10.42.42.10(pid=22495): Terminated {rc=256} 16:08:16.867280 --- ParallelTerminationStrategy: PID 22498 died... 16:08:16.900016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22498): Terminated: ok {rc=0} 16:08:16.956942 --- ParallelTerminationStrategy: PID 22501 died... 16:08:16.985927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22501): Terminated: ok {rc=0} 16:08:17.042691 --- ParallelTerminationStrategy: PID 22504 died... 16:08:17.066679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22504): Terminated: ok {rc=0} 16:08:17.185864 bus /gobi_0: Setting Powered False 16:08:18.330324 bus /gobi_0: Setting Powered False 16:08:19.462856 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 16:08:20.617502 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:20.629833 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:08:20.683711 tst iperf3.py: using LAC 29096 16:08:20.809565 tst iperf3.py: using RAC 26 16:08:20.933097 tst iperf3.py: using CellId 29096 16:08:21.055410 tst iperf3.py: using BVCI 29097 16:08:21.167584 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:21.179434 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:21.190998 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:21.203175 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:21.217569 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:21.229015 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:21.241910 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:21.256251 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:21.268264 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:21.388935 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:08:21.598702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:21.925873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22778): Launched 16:08:22.205285 run iperf3-srv_10.42.42.10(pid=22779): Launched 16:08:22.336896 tst iperf3.py:8: start network... 16:08:22.545190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:23.029881 run create_hlr_db(pid=22780): Launched 16:08:23.189365 bus /gobi_6: Setting Powered False 16:08:24.252682 run create_hlr_db(pid=22780): Terminated: ok {rc=0} 16:08:24.696287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22782): Launched 16:08:25.024876 run osmo-hlr_10.42.42.2(pid=22783): Launched 16:08:25.275438 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:25.946751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22785): Launched 16:08:26.289091 run osmo-stp_10.42.42.5(pid=22786): Launched 16:08:26.538299 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:08:27.191096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22788): Launched 16:08:27.328067 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:08:27.610050 run patchelf(pid=22789): Launched 16:08:27.808710 run osmo-stp_10.42.42.5(pid=22786): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22786)] 16:08:27.950422 run osmo-stp_10.42.42.5(pid=22786): stdout: | (launched: 2022-12-10_16:08:26.228742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:28.094137 run osmo-stp_10.42.42.5(pid=22786): stderr: | [0;m[38;5;43m20221210160826522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160826522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160826522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160826523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160826523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160826523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160826523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:28.237464 run osmo-stp_10.42.42.5(pid=22786): stdout: | (launched: 2022-12-10_16:08:26.228742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:28.374360 run osmo-stp_10.42.42.5(pid=22786): stderr: | [0;m[38;5;43m20221210160826522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160826522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160826522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160826523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160826523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160826523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160826523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:28.537203 run patchelf(pid=22789): Terminating (SIGINT) 16:08:28.724489 run patchelf(pid=22789): Terminated: ok {rc=0} 16:08:28.859901 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22786): Process ended prematurely: osmo-stp_10.42.42.5(pid=22786) [trial-2376↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22786)] [trial-2376↪gprs:trx-sysmocell5000↪iperf3.py:8] 16:08:28.871288 tst iperf3.py:8: Test FAILED (8.3 sec) 16:08:28.901556 run osmo-hlr_10.42.42.2(pid=22783): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22783)] 16:08:28.954014 run osmo-hlr_10.42.42.2(pid=22783): stdout: | (launched: 2022-12-10_16:08:24.966403) 16:08:29.008172 run osmo-hlr_10.42.42.2(pid=22783): stderr: | [0;m[1;31m20221210160825271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160825271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160825271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160825271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160825271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160825271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160825295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160825308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160825308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160825308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:29.062777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22778): Terminating (SIGTERM) 16:08:29.106827 run iperf3-srv_10.42.42.10(pid=22779): Terminating (SIGTERM) 16:08:29.150716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22782): Terminating (SIGTERM) 16:08:29.195232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22785): Terminating (SIGTERM) 16:08:29.241431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22788): Terminating (SIGTERM) 16:08:29.287771 --- ParallelTerminationStrategy: PID 22778 died... 16:08:29.309098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22778): Terminated: ok {rc=0} 16:08:29.359528 --- ParallelTerminationStrategy: PID 22779 died... 16:08:29.380456 run iperf3-srv_10.42.42.10(pid=22779): Terminated {rc=256} 16:08:29.428907 --- ParallelTerminationStrategy: PID 22782 died... 16:08:29.449929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22782): Terminated: ok {rc=0} 16:08:29.500187 --- ParallelTerminationStrategy: PID 22785 died... 16:08:29.521587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22785): Terminated: ok {rc=0} 16:08:29.569573 --- ParallelTerminationStrategy: PID 22788 died... 16:08:29.590299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22788): Terminated: ok {rc=0} 16:08:29.681813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 16:08:30.839386 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:30.852826 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:08:30.905277 tst iperf3m4.py: using LAC 29097 16:08:31.067363 tst iperf3m4.py: using RAC 27 16:08:31.207896 tst iperf3m4.py: using CellId 29097 16:08:31.387426 tst iperf3m4.py: using BVCI 29098 16:08:31.547128 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:31.561614 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:31.575569 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:31.589630 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:31.602697 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:31.618635 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:31.633632 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:31.647492 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:31.662794 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:31.814353 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:31.976456 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:32.124227 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:32.278843 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:08:32.517313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:32.831861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22790): Launched 16:08:33.117989 run iperf3-srv_10.42.42.10(pid=22791): Launched 16:08:33.295218 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:08:33.522446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:33.860084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22792): Launched 16:08:34.161610 run iperf3-srv_10.42.42.10(pid=22793): Launched 16:08:34.301423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:08:34.528353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:34.868374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22794): Launched 16:08:35.168130 run iperf3-srv_10.42.42.10(pid=22795): Launched 16:08:35.307613 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:08:35.534884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:35.873287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22796): Launched 16:08:36.174723 run iperf3-srv_10.42.42.10(pid=22797): Launched 16:08:36.314709 tst iperf3m4.py:8: start network... 16:08:36.544655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:37.063537 run create_hlr_db(pid=22798): Launched 16:08:37.232613 bus /gobi_6: Setting Powered False 16:08:38.298698 run create_hlr_db(pid=22798): Terminated: ok {rc=0} 16:08:38.766171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22800): Launched 16:08:39.113524 run osmo-hlr_10.42.42.2(pid=22801): Launched 16:08:39.364684 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:40.036404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22803): Launched 16:08:40.364755 run osmo-stp_10.42.42.5(pid=22804): Launched 16:08:40.487823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:08:41.050798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22806): Launched 16:08:41.175194 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:08:41.450604 run patchelf(pid=22807): Launched 16:08:41.633744 run osmo-stp_10.42.42.5(pid=22804): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22804)] 16:08:41.771335 run osmo-stp_10.42.42.5(pid=22804): stdout: | (launched: 2022-12-10_16:08:40.304756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:41.911396 run osmo-stp_10.42.42.5(pid=22804): stderr: | [0;m[38;5;43m20221210160840500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160840500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160840500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160840501 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160840501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160840501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160840501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:42.051238 run osmo-stp_10.42.42.5(pid=22804): stdout: | (launched: 2022-12-10_16:08:40.304756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:42.184849 run osmo-stp_10.42.42.5(pid=22804): stderr: | [0;m[38;5;43m20221210160840500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160840500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160840500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160840501 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160840501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160840501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160840501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:42.343096 run patchelf(pid=22807): Terminating (SIGINT) 16:08:42.525764 run patchelf(pid=22807): Terminated: ok {rc=0} 16:08:42.657705 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22804): Process ended prematurely: osmo-stp_10.42.42.5(pid=22804) [trial-2376↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22804)] [trial-2376↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 16:08:42.667996 tst iperf3m4.py:8: Test FAILED (11.9 sec) 16:08:42.696806 run osmo-hlr_10.42.42.2(pid=22801): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22801)] 16:08:42.747021 run osmo-hlr_10.42.42.2(pid=22801): stdout: | (launched: 2022-12-10_16:08:39.050919) 16:08:42.798972 run osmo-hlr_10.42.42.2(pid=22801): stderr: | [0;m[1;31m20221210160839355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160839355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160839355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160839355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160839355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160839355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160839375 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160839387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160839387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160839387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:42.851670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22790): Terminating (SIGTERM) 16:08:42.893715 run iperf3-srv_10.42.42.10(pid=22791): Terminating (SIGTERM) 16:08:42.935660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22792): Terminating (SIGTERM) 16:08:42.977862 run iperf3-srv_10.42.42.10(pid=22793): Terminating (SIGTERM) 16:08:43.019634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22794): Terminating (SIGTERM) 16:08:43.061772 run iperf3-srv_10.42.42.10(pid=22795): Terminating (SIGTERM) 16:08:43.103772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22796): Terminating (SIGTERM) 16:08:43.145884 run iperf3-srv_10.42.42.10(pid=22797): Terminating (SIGTERM) 16:08:43.187659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22800): Terminating (SIGTERM) 16:08:43.229762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22803): Terminating (SIGTERM) 16:08:43.271808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22806): Terminating (SIGTERM) 16:08:43.314312 --- ParallelTerminationStrategy: PID 22790 died... 16:08:43.334524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22790): Terminated: ok {rc=0} 16:08:43.381286 --- ParallelTerminationStrategy: PID 22791 died... 16:08:43.400898 run iperf3-srv_10.42.42.10(pid=22791): Terminated {rc=256} 16:08:43.447327 --- ParallelTerminationStrategy: PID 22792 died... 16:08:43.467095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22792): Terminated: ok {rc=0} 16:08:43.513652 --- ParallelTerminationStrategy: PID 22793 died... 16:08:43.533561 run iperf3-srv_10.42.42.10(pid=22793): Terminated {rc=256} 16:08:43.580050 --- ParallelTerminationStrategy: PID 22794 died... 16:08:43.599677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22794): Terminated: ok {rc=0} 16:08:43.645942 --- ParallelTerminationStrategy: PID 22795 died... 16:08:43.665624 run iperf3-srv_10.42.42.10(pid=22795): Terminated {rc=256} 16:08:43.711909 --- ParallelTerminationStrategy: PID 22796 died... 16:08:43.731615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22796): Terminated: ok {rc=0} 16:08:43.777852 --- ParallelTerminationStrategy: PID 22797 died... 16:08:43.797545 run iperf3-srv_10.42.42.10(pid=22797): Terminated {rc=256} 16:08:43.843638 --- ParallelTerminationStrategy: PID 22800 died... 16:08:43.863290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22800): Terminated: ok {rc=0} 16:08:43.909479 --- ParallelTerminationStrategy: PID 22803 died... 16:08:43.929187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22803): Terminated: ok {rc=0} 16:08:43.975503 --- ParallelTerminationStrategy: PID 22806 died... 16:08:43.995219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22806): Terminated: ok {rc=0} 16:08:44.083640 bus /gobi_4: Setting Powered False 16:08:45.185046 bus /gobi_4: Setting Powered False 16:08:46.300608 bus /gobi_1: Setting Powered False 16:08:47.399916 bus /gobi_1: Setting Powered False 16:08:48.515710 bus /gobi_0: Setting Powered False 16:08:49.614697 bus /gobi_0: Setting Powered False 16:08:50.732867 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 16:08:51.834695 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:51.846530 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:08:51.896677 tst ping.py: using LAC 29098 16:08:52.015881 tst ping.py: using RAC 28 16:08:52.133659 tst ping.py: using CellId 29098 16:08:52.260332 tst ping.py: using BVCI 29099 16:08:52.376249 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:52.387740 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:52.399145 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:52.410423 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:52.421654 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:52.432570 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:52.443749 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:52.454917 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:52.568052 tst ping.py:19: start network... 16:08:52.770388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:53.232575 run create_hlr_db(pid=22808): Launched 16:08:53.363091 bus /gobi_6: Setting Powered False 16:08:54.425112 run create_hlr_db(pid=22808): Terminated: ok {rc=0} 16:08:54.854574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22810): Launched 16:08:55.154133 run osmo-hlr_10.42.42.2(pid=22811): Launched 16:08:55.267694 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:55.786490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22813): Launched 16:08:56.086171 run osmo-stp_10.42.42.5(pid=22814): Launched 16:08:56.200023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:08:56.718954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22816): Launched 16:08:56.835861 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:08:57.090000 run patchelf(pid=22817): Launched 16:08:57.258958 run osmo-stp_10.42.42.5(pid=22814): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22814)] 16:08:57.386530 run osmo-stp_10.42.42.5(pid=22814): stdout: | (launched: 2022-12-10_16:08:56.031031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:57.515702 run osmo-stp_10.42.42.5(pid=22814): stderr: | [0;m[38;5;43m20221210160856201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160856201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160856201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160856201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160856202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160856202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160856202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:57.645190 run osmo-stp_10.42.42.5(pid=22814): stdout: | (launched: 2022-12-10_16:08:56.031031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:57.768376 run osmo-stp_10.42.42.5(pid=22814): stderr: | [0;m[38;5;43m20221210160856201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160856201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160856201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160856201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160856202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160856202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160856202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:57.915635 run patchelf(pid=22817): Terminating (SIGINT) 16:08:58.084139 run patchelf(pid=22817): Terminated: ok {rc=0} 16:08:58.206705 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22814): Process ended prematurely: osmo-stp_10.42.42.5(pid=22814) [trial-2376↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22814)] [trial-2376↪gprs:trx-sysmocell5000↪ping.py:22] 16:08:58.215604 tst ping.py:22: Test FAILED (6.4 sec) 16:08:58.243053 run osmo-hlr_10.42.42.2(pid=22811): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22811)] 16:08:58.291365 run osmo-hlr_10.42.42.2(pid=22811): stdout: | (launched: 2022-12-10_16:08:55.098780) 16:08:58.341504 run osmo-hlr_10.42.42.2(pid=22811): stderr: | [0;m[1;31m20221210160855276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160855276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160855276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160855276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160855276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160855276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160855288 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160855297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160855298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160855298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:58.391960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22810): Terminating (SIGTERM) 16:08:58.432476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22813): Terminating (SIGTERM) 16:08:58.473029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22816): Terminating (SIGTERM) 16:08:58.513824 --- ParallelTerminationStrategy: PID 22810 died... 16:08:58.533265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22810): Terminated: ok {rc=0} 16:08:58.579157 --- ParallelTerminationStrategy: PID 22813 died... 16:08:58.598219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22813): Terminated: ok {rc=0} 16:08:58.643419 --- ParallelTerminationStrategy: PID 22816 died... 16:08:58.662350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22816): Terminated: ok {rc=0} 16:08:58.747583 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 16:08:59.834665 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:59.847024 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:08:59.902287 tst ping_idle_ping.py: using LAC 29099 16:09:00.027458 tst ping_idle_ping.py: using RAC 29 16:09:00.151459 tst ping_idle_ping.py: using CellId 29099 16:09:00.277701 tst ping_idle_ping.py: using BVCI 29100 16:09:00.396043 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:00.407545 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:00.418803 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:00.430052 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:00.441222 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:00.452426 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:00.463806 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:09:00.474983 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:09:00.594924 tst ping_idle_ping.py:24: start network... 16:09:00.810717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:01.350333 run create_hlr_db(pid=22818): Launched 16:09:01.482264 bus /gobi_6: Setting Powered False 16:09:02.546944 run create_hlr_db(pid=22818): Terminated: ok {rc=0} 16:09:02.996711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22820): Launched 16:09:03.317698 run osmo-hlr_10.42.42.2(pid=22821): Launched 16:09:03.440473 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:03.997104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22823): Launched 16:09:04.317695 run osmo-stp_10.42.42.5(pid=22824): Launched 16:09:04.440712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:04.994919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22826): Launched 16:09:05.118616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:05.389291 run patchelf(pid=22827): Launched 16:09:05.567017 run osmo-stp_10.42.42.5(pid=22824): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22824)] 16:09:05.702154 run osmo-stp_10.42.42.5(pid=22824): stdout: | (launched: 2022-12-10_16:09:04.258833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:05.839060 run osmo-stp_10.42.42.5(pid=22824): stderr: | [0;m[38;5;43m20221210160904452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160904453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160904453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160904453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160904454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160904454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160904454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:05.975752 run osmo-stp_10.42.42.5(pid=22824): stdout: | (launched: 2022-12-10_16:09:04.258833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:06.107087 run osmo-stp_10.42.42.5(pid=22824): stderr: | [0;m[38;5;43m20221210160904452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160904453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160904453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160904453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160904454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160904454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160904454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:06.262469 run patchelf(pid=22827): Terminating (SIGINT) 16:09:06.442643 run patchelf(pid=22827): Terminated: ok {rc=0} 16:09:06.572535 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22824): Process ended prematurely: osmo-stp_10.42.42.5(pid=22824) [trial-2376↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22824)] [trial-2376↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 16:09:06.582302 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:09:06.610696 run osmo-hlr_10.42.42.2(pid=22821): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22821)] 16:09:06.660696 run osmo-hlr_10.42.42.2(pid=22821): stdout: | (launched: 2022-12-10_16:09:03.258636) 16:09:06.712589 run osmo-hlr_10.42.42.2(pid=22821): stderr: | [0;m[1;31m20221210160903458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160903458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160903458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160903458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160903458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160903458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160903471 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160903479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160903479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160903479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:06.764873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22820): Terminating (SIGTERM) 16:09:06.806835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22823): Terminating (SIGTERM) 16:09:06.848822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22826): Terminating (SIGTERM) 16:09:06.891065 --- ParallelTerminationStrategy: PID 22820 died... 16:09:06.911103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22820): Terminated: ok {rc=0} 16:09:06.957883 --- ParallelTerminationStrategy: PID 22823 died... 16:09:06.977626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22823): Terminated: ok {rc=0} 16:09:07.024352 --- ParallelTerminationStrategy: PID 22826 died... 16:09:07.044306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22826): Terminated: ok {rc=0} 16:09:07.132618 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 16:09:08.440912 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:09:08.446369 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:09:08.480811 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:09:08.519164 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:09:08.605610 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:09:08.638967 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:09:08.677120 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:09:09.273257 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:09:09.322641 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:09.333801 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:09:09.384605 tst cs_paging_gprs_active.py: using LAC 29100 16:09:09.505792 tst cs_paging_gprs_active.py: using RAC 30 16:09:09.625463 tst cs_paging_gprs_active.py: using CellId 29100 16:09:09.754511 tst cs_paging_gprs_active.py: using BVCI 29101 16:09:09.874695 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:09.886496 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:09.898077 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:09.909626 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:09.920888 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:09.932392 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:09.943906 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:09.955115 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:09.966504 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:10.084617 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:10.201618 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:09:10.410202 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:10.719081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22832): Launched 16:09:10.987907 run iperf3-srv_10.42.42.10(pid=22833): Launched 16:09:11.103888 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:09:11.311198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:11.622413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22834): Launched 16:09:11.889981 run iperf3-srv_10.42.42.10(pid=22835): Launched 16:09:12.006981 tst cs_paging_gprs_active.py:38: start network... 16:09:12.213806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:12.691219 run create_hlr_db(pid=22836): Launched 16:09:12.808395 bus /gobi_6: Setting Powered False 16:09:13.869676 run create_hlr_db(pid=22836): Terminated: ok {rc=0} 16:09:14.298479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22838): Launched 16:09:14.605557 run osmo-hlr_10.42.42.2(pid=22839): Launched 16:09:14.722108 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:15.261686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22841): Launched 16:09:15.569232 run osmo-stp_10.42.42.5(pid=22842): Launched 16:09:15.686493 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:16.230409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22844): Launched 16:09:16.399449 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:16.760067 run patchelf(pid=22845): Launched 16:09:16.982808 run osmo-stp_10.42.42.5(pid=22842): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22842)] 16:09:17.127044 run osmo-stp_10.42.42.5(pid=22842): stdout: | (launched: 2022-12-10_16:09:15.511788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:17.272304 run osmo-stp_10.42.42.5(pid=22842): stderr: | [0;m[38;5;43m20221210160915686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160915686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160915686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160915686 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160915687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160915687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160915687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:17.414422 run osmo-stp_10.42.42.5(pid=22842): stdout: | (launched: 2022-12-10_16:09:15.511788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:17.548848 run osmo-stp_10.42.42.5(pid=22842): stderr: | [0;m[38;5;43m20221210160915686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160915686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160915686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160915686 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160915687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160915687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160915687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:17.708096 run patchelf(pid=22845): Terminating (SIGINT) 16:09:17.891082 run patchelf(pid=22845): Terminated: ok {rc=0} 16:09:18.023197 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22842): Process ended prematurely: osmo-stp_10.42.42.5(pid=22842) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22842)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:09:18.033581 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:09:18.062475 run osmo-hlr_10.42.42.2(pid=22839): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22839)] 16:09:18.112734 run osmo-hlr_10.42.42.2(pid=22839): stdout: | (launched: 2022-12-10_16:09:14.549240) 16:09:18.164468 run osmo-hlr_10.42.42.2(pid=22839): stderr: | [0;m[1;31m20221210160914730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160914730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160914730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160914730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160914730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160914730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160914742 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160914751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160914751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160914751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:18.216535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22832): Terminating (SIGTERM) 16:09:18.258454 run iperf3-srv_10.42.42.10(pid=22833): Terminating (SIGTERM) 16:09:18.300425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22834): Terminating (SIGTERM) 16:09:18.342666 run iperf3-srv_10.42.42.10(pid=22835): Terminating (SIGTERM) 16:09:18.385319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22838): Terminating (SIGTERM) 16:09:18.427472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22841): Terminating (SIGTERM) 16:09:18.469556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22844): Terminating (SIGTERM) 16:09:18.511744 --- ParallelTerminationStrategy: PID 22832 died... 16:09:18.531582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22832): Terminated: ok {rc=0} 16:09:18.578521 --- ParallelTerminationStrategy: PID 22833 died... 16:09:18.598689 run iperf3-srv_10.42.42.10(pid=22833): Terminated {rc=256} 16:09:18.645184 --- ParallelTerminationStrategy: PID 22834 died... 16:09:18.664765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22834): Terminated: ok {rc=0} 16:09:18.711019 --- ParallelTerminationStrategy: PID 22835 died... 16:09:18.730721 run iperf3-srv_10.42.42.10(pid=22835): Terminated {rc=256} 16:09:18.777182 --- ParallelTerminationStrategy: PID 22838 died... 16:09:18.796756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22838): Terminated: ok {rc=0} 16:09:18.842786 --- ParallelTerminationStrategy: PID 22841 died... 16:09:18.862473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22841): Terminated: ok {rc=0} 16:09:18.908681 --- ParallelTerminationStrategy: PID 22844 died... 16:09:18.928489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22844): Terminated: ok {rc=0} 16:09:19.016084 bus /gobi_0: Setting Powered False 16:09:20.117123 bus /gobi_0: Setting Powered False 16:09:21.234803 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:09:22.382113 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:22.393893 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:09:22.447829 tst iperf3.py: using LAC 29101 16:09:22.571389 tst iperf3.py: using RAC 31 16:09:22.690988 tst iperf3.py: using CellId 29101 16:09:22.808466 tst iperf3.py: using BVCI 29102 16:09:22.918647 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:22.929873 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:22.940627 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:22.951619 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:22.962612 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:22.973688 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:22.984638 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:22.995586 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:23.006720 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:23.126771 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:09:23.346257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:23.673177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22846): Launched 16:09:23.955250 run iperf3-srv_10.42.42.10(pid=22847): Launched 16:09:24.078271 tst iperf3.py:8: start network... 16:09:24.298147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:24.803488 run create_hlr_db(pid=22848): Launched 16:09:24.936093 bus /gobi_6: Setting Powered False 16:09:26.001305 run create_hlr_db(pid=22848): Terminated: ok {rc=0} 16:09:26.438736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22850): Launched 16:09:26.746256 run osmo-hlr_10.42.42.2(pid=22851): Launched 16:09:26.862578 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:27.402005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22853): Launched 16:09:27.707395 run osmo-stp_10.42.42.5(pid=22854): Launched 16:09:27.823327 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:28.350129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22856): Launched 16:09:28.467149 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:28.725918 run patchelf(pid=22857): Launched 16:09:28.895096 run osmo-stp_10.42.42.5(pid=22854): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22854)] 16:09:29.024649 run osmo-stp_10.42.42.5(pid=22854): stdout: | (launched: 2022-12-10_16:09:27.651346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:29.156289 run osmo-stp_10.42.42.5(pid=22854): stderr: | [0;m[38;5;43m20221210160927825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160927825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160927825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160927826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160927826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160927826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160927826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:29.288484 run osmo-stp_10.42.42.5(pid=22854): stdout: | (launched: 2022-12-10_16:09:27.651346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:29.414201 run osmo-stp_10.42.42.5(pid=22854): stderr: | [0;m[38;5;43m20221210160927825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160927825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160927825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160927826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160927826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160927826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160927826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:29.563246 run patchelf(pid=22857): Terminating (SIGINT) 16:09:29.735092 run patchelf(pid=22857): Terminated: ok {rc=0} 16:09:29.858973 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22854): Process ended prematurely: osmo-stp_10.42.42.5(pid=22854) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22854)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 16:09:29.868477 tst iperf3.py:8: Test FAILED (7.5 sec) 16:09:29.896104 run osmo-hlr_10.42.42.2(pid=22851): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22851)] 16:09:29.943753 run osmo-hlr_10.42.42.2(pid=22851): stdout: | (launched: 2022-12-10_16:09:26.689959) 16:09:29.993123 run osmo-hlr_10.42.42.2(pid=22851): stderr: | [0;m[1;31m20221210160926866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160926866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160926866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160926866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160926866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160926866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160926878 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160926887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160926887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160926887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:30.042837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22846): Terminating (SIGTERM) 16:09:30.083199 run iperf3-srv_10.42.42.10(pid=22847): Terminating (SIGTERM) 16:09:30.123310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22850): Terminating (SIGTERM) 16:09:30.163432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22853): Terminating (SIGTERM) 16:09:30.203289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22856): Terminating (SIGTERM) 16:09:30.243800 --- ParallelTerminationStrategy: PID 22846 died... 16:09:30.263019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22846): Terminated: ok {rc=0} 16:09:30.308026 --- ParallelTerminationStrategy: PID 22847 died... 16:09:30.326820 run iperf3-srv_10.42.42.10(pid=22847): Terminated {rc=256} 16:09:30.371290 --- ParallelTerminationStrategy: PID 22850 died... 16:09:30.390013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22850): Terminated: ok {rc=0} 16:09:30.434365 --- ParallelTerminationStrategy: PID 22853 died... 16:09:30.453297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22853): Terminated: ok {rc=0} 16:09:30.497750 --- ParallelTerminationStrategy: PID 22856 died... 16:09:30.516623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22856): Terminated: ok {rc=0} 16:09:30.601035 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:09:31.759822 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:31.772481 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:09:31.826473 tst iperf3m4.py: using LAC 29102 16:09:31.954496 tst iperf3m4.py: using RAC 32 16:09:32.116288 tst iperf3m4.py: using CellId 29102 16:09:32.245029 tst iperf3m4.py: using BVCI 29103 16:09:32.361146 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:32.372564 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:32.383799 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:32.395050 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:32.406232 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:32.417462 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:32.429323 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:32.440501 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:32.452062 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:32.567976 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:32.689632 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:32.808494 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:32.925693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:09:33.126912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:33.428027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22858): Launched 16:09:33.690405 run iperf3-srv_10.42.42.10(pid=22859): Launched 16:09:33.803092 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:09:34.003721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:34.304589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22860): Launched 16:09:34.566121 run iperf3-srv_10.42.42.10(pid=22863): Launched 16:09:34.678411 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:09:34.878626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:35.178573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22864): Launched 16:09:35.439173 run iperf3-srv_10.42.42.10(pid=22865): Launched 16:09:35.551820 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:09:35.753399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:36.054294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22866): Launched 16:09:36.315246 run iperf3-srv_10.42.42.10(pid=22867): Launched 16:09:36.427654 tst iperf3m4.py:8: start network... 16:09:36.628565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:37.090321 run create_hlr_db(pid=22868): Launched 16:09:37.203945 bus /gobi_6: Setting Powered False 16:09:38.264365 run create_hlr_db(pid=22868): Terminated: ok {rc=0} 16:09:38.682586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22870): Launched 16:09:38.981665 run osmo-hlr_10.42.42.2(pid=22871): Launched 16:09:39.095131 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:39.622527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22873): Launched 16:09:39.921678 run osmo-stp_10.42.42.5(pid=22874): Launched 16:09:40.035819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:40.551354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22876): Launched 16:09:40.666569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:40.919077 run patchelf(pid=22877): Launched 16:09:41.085094 run osmo-stp_10.42.42.5(pid=22874): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22874)] 16:09:41.211827 run osmo-stp_10.42.42.5(pid=22874): stdout: | (launched: 2022-12-10_16:09:39.866698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:41.340393 run osmo-stp_10.42.42.5(pid=22874): stderr: | [0;m[38;5;43m20221210160940033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160940033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160940033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160940034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160940034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160940034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160940035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:41.469110 run osmo-stp_10.42.42.5(pid=22874): stdout: | (launched: 2022-12-10_16:09:39.866698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:41.591781 run osmo-stp_10.42.42.5(pid=22874): stderr: | [0;m[38;5;43m20221210160940033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160940033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160940033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160940034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160940034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160940034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160940035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:41.737178 run patchelf(pid=22877): Terminating (SIGINT) 16:09:41.905412 run patchelf(pid=22877): Terminated: ok {rc=0} 16:09:42.027329 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22874): Process ended prematurely: osmo-stp_10.42.42.5(pid=22874) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22874)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 16:09:42.037020 tst iperf3m4.py:8: Test FAILED (10.3 sec) 16:09:42.065154 run osmo-hlr_10.42.42.2(pid=22871): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22871)] 16:09:42.112901 run osmo-hlr_10.42.42.2(pid=22871): stdout: | (launched: 2022-12-10_16:09:38.927112) 16:09:42.162792 run osmo-hlr_10.42.42.2(pid=22871): stderr: | [0;m[1;31m20221210160939101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160939101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160939101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160939101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160939101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160939101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160939114 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160939122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160939122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160939122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:42.212865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22858): Terminating (SIGTERM) 16:09:42.253041 run iperf3-srv_10.42.42.10(pid=22859): Terminating (SIGTERM) 16:09:42.292837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22860): Terminating (SIGTERM) 16:09:42.333076 run iperf3-srv_10.42.42.10(pid=22863): Terminating (SIGTERM) 16:09:42.372990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22864): Terminating (SIGTERM) 16:09:42.413032 run iperf3-srv_10.42.42.10(pid=22865): Terminating (SIGTERM) 16:09:42.452926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22866): Terminating (SIGTERM) 16:09:42.493053 run iperf3-srv_10.42.42.10(pid=22867): Terminating (SIGTERM) 16:09:42.532937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22870): Terminating (SIGTERM) 16:09:42.573322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22873): Terminating (SIGTERM) 16:09:42.613449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22876): Terminating (SIGTERM) 16:09:42.653832 --- ParallelTerminationStrategy: PID 22858 died... 16:09:42.673009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22858): Terminated: ok {rc=0} 16:09:42.717826 --- ParallelTerminationStrategy: PID 22859 died... 16:09:42.736286 run iperf3-srv_10.42.42.10(pid=22859): Terminated {rc=256} 16:09:42.780676 --- ParallelTerminationStrategy: PID 22860 died... 16:09:42.799249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22860): Terminated: ok {rc=0} 16:09:42.843257 --- ParallelTerminationStrategy: PID 22863 died... 16:09:42.861692 run iperf3-srv_10.42.42.10(pid=22863): Terminated {rc=256} 16:09:42.906738 --- ParallelTerminationStrategy: PID 22864 died... 16:09:42.925109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22864): Terminated: ok {rc=0} 16:09:42.969312 --- ParallelTerminationStrategy: PID 22865 died... 16:09:42.987832 run iperf3-srv_10.42.42.10(pid=22865): Terminated {rc=256} 16:09:43.031800 --- ParallelTerminationStrategy: PID 22866 died... 16:09:43.050132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22866): Terminated: ok {rc=0} 16:09:43.094339 --- ParallelTerminationStrategy: PID 22867 died... 16:09:43.112915 run iperf3-srv_10.42.42.10(pid=22867): Terminated {rc=256} 16:09:43.157013 --- ParallelTerminationStrategy: PID 22870 died... 16:09:43.175310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22870): Terminated: ok {rc=0} 16:09:43.219183 --- ParallelTerminationStrategy: PID 22873 died... 16:09:43.237594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22873): Terminated: ok {rc=0} 16:09:43.281480 --- ParallelTerminationStrategy: PID 22876 died... 16:09:43.300015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22876): Terminated: ok {rc=0} 16:09:43.386459 bus /gobi_4: Setting Powered False 16:09:44.487006 bus /gobi_4: Setting Powered False 16:09:45.603421 bus /gobi_1: Setting Powered False 16:09:46.703312 bus /gobi_1: Setting Powered False 16:09:47.822361 bus /gobi_0: Setting Powered False 16:09:48.923386 bus /gobi_0: Setting Powered False 16:09:50.042591 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 16:09:51.146698 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:51.158426 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:09:51.210027 tst ping.py: using LAC 29103 16:09:51.327896 tst ping.py: using RAC 33 16:09:51.444942 tst ping.py: using CellId 29103 16:09:51.561535 tst ping.py: using BVCI 29104 16:09:51.676229 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:51.688069 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:51.699664 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:51.711393 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:51.723053 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:51.734694 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:51.746585 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:51.758213 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:51.872155 tst ping.py:19: start network... 16:09:52.070270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:52.525624 run create_hlr_db(pid=22879): Launched 16:09:52.639356 bus /gobi_6: Setting Powered False 16:09:53.698213 run create_hlr_db(pid=22879): Terminated: ok {rc=0} 16:09:54.129397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22881): Launched 16:09:54.443414 run osmo-hlr_10.42.42.2(pid=22882): Launched 16:09:54.563247 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:55.106932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22884): Launched 16:09:55.421056 run osmo-stp_10.42.42.5(pid=22885): Launched 16:09:55.540820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:56.085622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22887): Launched 16:09:56.205853 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:56.471897 run patchelf(pid=22888): Launched 16:09:56.647748 run osmo-stp_10.42.42.5(pid=22885): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22885)] 16:09:56.781597 run osmo-stp_10.42.42.5(pid=22885): stdout: | (launched: 2022-12-10_16:09:55.363773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:56.916660 run osmo-stp_10.42.42.5(pid=22885): stderr: | [0;m[38;5;43m20221210160955554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160955554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160955555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160955555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160955555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160955555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160955556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:57.051487 run osmo-stp_10.42.42.5(pid=22885): stdout: | (launched: 2022-12-10_16:09:55.363773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:57.180405 run osmo-stp_10.42.42.5(pid=22885): stderr: | [0;m[38;5;43m20221210160955554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210160955554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210160955555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210160955555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210160955555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210160955555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210160955556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:57.333225 run patchelf(pid=22888): Terminating (SIGINT) 16:09:57.509584 run patchelf(pid=22888): Terminated: ok {rc=0} 16:09:57.636819 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22885): Process ended prematurely: osmo-stp_10.42.42.5(pid=22885) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22885)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 16:09:57.646342 tst ping.py:22: Test FAILED (6.5 sec) 16:09:57.674668 run osmo-hlr_10.42.42.2(pid=22882): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22882)] 16:09:57.724660 run osmo-hlr_10.42.42.2(pid=22882): stdout: | (launched: 2022-12-10_16:09:54.386213) 16:09:57.776620 run osmo-hlr_10.42.42.2(pid=22882): stderr: | [0;m[1;31m20221210160954583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210160954583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210160954583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210160954583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210160954583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210160954583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210160954596 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210160954605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210160954605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210160954605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:57.829198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22881): Terminating (SIGTERM) 16:09:57.871339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22884): Terminating (SIGTERM) 16:09:57.913593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22887): Terminating (SIGTERM) 16:09:57.956067 --- ParallelTerminationStrategy: PID 22881 died... 16:09:57.976051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22881): Terminated: ok {rc=0} 16:09:58.023231 --- ParallelTerminationStrategy: PID 22884 died... 16:09:58.042998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22884): Terminated: ok {rc=0} 16:09:58.089575 --- ParallelTerminationStrategy: PID 22887 died... 16:09:58.109320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22887): Terminated: ok {rc=0} 16:09:58.197421 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:09:59.284796 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:59.296931 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:09:59.351024 tst ping_idle_ping.py: using LAC 29104 16:09:59.468628 tst ping_idle_ping.py: using RAC 34 16:09:59.584779 tst ping_idle_ping.py: using CellId 29104 16:09:59.701329 tst ping_idle_ping.py: using BVCI 29105 16:09:59.810040 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:59.821260 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:59.832108 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:59.843684 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:59.855290 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:59.866889 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:59.878665 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:59.890136 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:10:00.004655 tst ping_idle_ping.py:24: start network... 16:10:00.202841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:00.662387 run create_hlr_db(pid=22889): Launched 16:10:00.775638 bus /gobi_6: Setting Powered False 16:10:01.862415 run create_hlr_db(pid=22889): Terminated: ok {rc=0} 16:10:02.376128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22894): Launched 16:10:02.692557 run osmo-hlr_10.42.42.2(pid=22895): Launched 16:10:02.813254 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:03.354288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22897): Launched 16:10:03.668809 run osmo-stp_10.42.42.5(pid=22898): Launched 16:10:03.788096 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:04.330410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22900): Launched 16:10:04.450913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:04.718397 run patchelf(pid=22901): Launched 16:10:04.884177 run osmo-stp_10.42.42.5(pid=22898): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22898)] 16:10:05.009253 run osmo-stp_10.42.42.5(pid=22898): stdout: | (launched: 2022-12-10_16:10:03.610860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:05.135904 run osmo-stp_10.42.42.5(pid=22898): stderr: | [0;m[38;5;43m20221210161003803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161003804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161003804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161003804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161003805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161003805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161003805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:05.262925 run osmo-stp_10.42.42.5(pid=22898): stdout: | (launched: 2022-12-10_16:10:03.610860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:05.383894 run osmo-stp_10.42.42.5(pid=22898): stderr: | [0;m[38;5;43m20221210161003803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161003804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161003804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161003804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161003805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161003805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161003805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:05.527032 run patchelf(pid=22901): Terminating (SIGINT) 16:10:05.692598 run patchelf(pid=22901): Terminated: ok {rc=0} 16:10:05.811448 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22898): Process ended prematurely: osmo-stp_10.42.42.5(pid=22898) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22898)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 16:10:05.820202 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:10:05.847006 run osmo-hlr_10.42.42.2(pid=22895): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22895)] 16:10:05.894682 run osmo-hlr_10.42.42.2(pid=22895): stdout: | (launched: 2022-12-10_16:10:02.635077) 16:10:05.943259 run osmo-hlr_10.42.42.2(pid=22895): stderr: | [0;m[1;31m20221210161002836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161002836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161002836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161002836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161002836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161002837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161002851 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161002860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161002860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161002860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:05.992920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22894): Terminating (SIGTERM) 16:10:06.032798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22897): Terminating (SIGTERM) 16:10:06.072540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22900): Terminating (SIGTERM) 16:10:06.112648 --- ParallelTerminationStrategy: PID 22894 died... 16:10:06.131797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22894): Terminated: ok {rc=0} 16:10:06.176304 --- ParallelTerminationStrategy: PID 22897 died... 16:10:06.194837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22897): Terminated: ok {rc=0} 16:10:06.239769 --- ParallelTerminationStrategy: PID 22900 died... 16:10:06.258627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22900): Terminated: ok {rc=0} 16:10:06.343604 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:10:07.652112 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:10:07.658033 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:10:07.691835 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:10:07.729935 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:10:07.815598 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:10:07.848808 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:10:07.886666 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:10:08.481427 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:10:08.529906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:08.540819 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:10:08.614973 tst cs_paging_gprs_active.py: using LAC 29105 16:10:08.731029 tst cs_paging_gprs_active.py: using RAC 35 16:10:08.848119 tst cs_paging_gprs_active.py: using CellId 29105 16:10:08.964394 tst cs_paging_gprs_active.py: using BVCI 29106 16:10:09.072750 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:09.083664 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:09.094425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:09.105515 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:09.116366 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:09.127261 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:09.138294 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:09.149164 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:09.160305 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:09.277477 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:09.391978 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:10:09.595000 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:09.896468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22906): Launched 16:10:10.158651 run iperf3-srv_10.42.42.10(pid=22907): Launched 16:10:10.270997 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:10:10.472744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:10.774911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22908): Launched 16:10:11.036394 run iperf3-srv_10.42.42.10(pid=22909): Launched 16:10:11.149258 tst cs_paging_gprs_active.py:38: start network... 16:10:11.350814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:11.813706 run create_hlr_db(pid=22910): Launched 16:10:11.928837 bus /gobi_6: Setting Powered False 16:10:12.988400 run create_hlr_db(pid=22910): Terminated: ok {rc=0} 16:10:13.421211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22912): Launched 16:10:13.739051 run osmo-hlr_10.42.42.2(pid=22913): Launched 16:10:13.859796 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:14.403524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22915): Launched 16:10:14.720245 run osmo-stp_10.42.42.5(pid=22916): Launched 16:10:14.840770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:15.385689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22918): Launched 16:10:15.506023 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:15.773272 run patchelf(pid=22919): Launched 16:10:15.973392 run osmo-stp_10.42.42.5(pid=22916): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22916)] 16:10:16.118204 run osmo-stp_10.42.42.5(pid=22916): stdout: | (launched: 2022-12-10_16:10:14.661902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:16.256232 run osmo-stp_10.42.42.5(pid=22916): stderr: | [0;m[38;5;43m20221210161014853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161014853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161014853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161014854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161014854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161014854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161014854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:16.394655 run osmo-stp_10.42.42.5(pid=22916): stdout: | (launched: 2022-12-10_16:10:14.661902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:16.526480 run osmo-stp_10.42.42.5(pid=22916): stderr: | [0;m[38;5;43m20221210161014853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161014853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161014853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161014854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161014854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161014854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161014854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:16.683332 run patchelf(pid=22919): Terminating (SIGINT) 16:10:16.864195 run patchelf(pid=22919): Terminated: ok {rc=0} 16:10:16.994731 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22916): Process ended prematurely: osmo-stp_10.42.42.5(pid=22916) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22916)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:10:17.006629 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:10:17.035789 run osmo-hlr_10.42.42.2(pid=22913): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22913)] 16:10:17.086745 run osmo-hlr_10.42.42.2(pid=22913): stdout: | (launched: 2022-12-10_16:10:13.681733) 16:10:17.139082 run osmo-hlr_10.42.42.2(pid=22913): stderr: | [0;m[1;31m20221210161013880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161013880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161013880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161013880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161013880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161013880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161013893 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161013902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161013902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161013902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:17.190939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22906): Terminating (SIGTERM) 16:10:17.232215 run iperf3-srv_10.42.42.10(pid=22907): Terminating (SIGTERM) 16:10:17.273300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22908): Terminating (SIGTERM) 16:10:17.314616 run iperf3-srv_10.42.42.10(pid=22909): Terminating (SIGTERM) 16:10:17.355930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22912): Terminating (SIGTERM) 16:10:17.397055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22915): Terminating (SIGTERM) 16:10:17.438478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22918): Terminating (SIGTERM) 16:10:17.479896 --- ParallelTerminationStrategy: PID 22906 died... 16:10:17.499701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22906): Terminated: ok {rc=0} 16:10:17.545652 --- ParallelTerminationStrategy: PID 22907 died... 16:10:17.565054 run iperf3-srv_10.42.42.10(pid=22907): Terminated {rc=256} 16:10:17.610913 --- ParallelTerminationStrategy: PID 22908 died... 16:10:17.630317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22908): Terminated: ok {rc=0} 16:10:17.675814 --- ParallelTerminationStrategy: PID 22909 died... 16:10:17.694978 run iperf3-srv_10.42.42.10(pid=22909): Terminated {rc=256} 16:10:17.740493 --- ParallelTerminationStrategy: PID 22912 died... 16:10:17.759926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22912): Terminated: ok {rc=0} 16:10:17.805495 --- ParallelTerminationStrategy: PID 22915 died... 16:10:17.824879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22915): Terminated: ok {rc=0} 16:10:17.870578 --- ParallelTerminationStrategy: PID 22918 died... 16:10:17.889889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22918): Terminated: ok {rc=0} 16:10:17.976724 bus /gobi_0: Setting Powered False 16:10:19.073903 bus /gobi_0: Setting Powered False 16:10:20.188830 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:10:21.335652 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.347899 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:10:21.423157 tst iperf3.py: using LAC 29106 16:10:21.541773 tst iperf3.py: using RAC 36 16:10:21.657843 tst iperf3.py: using CellId 29106 16:10:21.783969 tst iperf3.py: using BVCI 29107 16:10:21.892342 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.903394 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.914179 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.925081 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.936034 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.947007 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.958130 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.968937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.980075 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:22.096801 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:10:22.311972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:22.630110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22920): Launched 16:10:22.905715 run iperf3-srv_10.42.42.10(pid=22921): Launched 16:10:23.024106 tst iperf3.py:8: start network... 16:10:23.237585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:23.728773 run create_hlr_db(pid=22922): Launched 16:10:23.857793 bus /gobi_6: Setting Powered False 16:10:24.921608 run create_hlr_db(pid=22922): Terminated: ok {rc=0} 16:10:25.346247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22924): Launched 16:10:25.642468 run osmo-hlr_10.42.42.2(pid=22925): Launched 16:10:25.756315 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:26.281416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22927): Launched 16:10:26.577467 run osmo-stp_10.42.42.5(pid=22928): Launched 16:10:26.690424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:27.202882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22930): Launched 16:10:27.316281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:27.566657 run patchelf(pid=22931): Launched 16:10:27.731248 run osmo-stp_10.42.42.5(pid=22928): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22928)] 16:10:27.856923 run osmo-stp_10.42.42.5(pid=22928): stdout: | (launched: 2022-12-10_16:10:26.523328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:27.984407 run osmo-stp_10.42.42.5(pid=22928): stderr: | [0;m[38;5;43m20221210161026692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161026692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161026692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161026693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161026693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161026693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161026693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:28.111858 run osmo-stp_10.42.42.5(pid=22928): stdout: | (launched: 2022-12-10_16:10:26.523328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:28.233128 run osmo-stp_10.42.42.5(pid=22928): stderr: | [0;m[38;5;43m20221210161026692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161026692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161026692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161026693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161026693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161026693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161026693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:28.376897 run patchelf(pid=22931): Terminating (SIGINT) 16:10:28.543838 run patchelf(pid=22931): Terminated: ok {rc=0} 16:10:28.664392 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22928): Process ended prematurely: osmo-stp_10.42.42.5(pid=22928) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22928)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 16:10:28.673851 tst iperf3.py:8: Test FAILED (7.4 sec) 16:10:28.701210 run osmo-hlr_10.42.42.2(pid=22925): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22925)] 16:10:28.749288 run osmo-hlr_10.42.42.2(pid=22925): stdout: | (launched: 2022-12-10_16:10:25.588598) 16:10:28.798735 run osmo-hlr_10.42.42.2(pid=22925): stderr: | [0;m[1;31m20221210161025762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161025762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161025762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161025762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161025762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161025762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161025774 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161025783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161025783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161025783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:28.848839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22920): Terminating (SIGTERM) 16:10:28.889042 run iperf3-srv_10.42.42.10(pid=22921): Terminating (SIGTERM) 16:10:28.929530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22924): Terminating (SIGTERM) 16:10:28.969651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22927): Terminating (SIGTERM) 16:10:29.009737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22930): Terminating (SIGTERM) 16:10:29.050075 --- ParallelTerminationStrategy: PID 22920 died... 16:10:29.069271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22920): Terminated: ok {rc=0} 16:10:29.114086 --- ParallelTerminationStrategy: PID 22921 died... 16:10:29.132559 run iperf3-srv_10.42.42.10(pid=22921): Terminated {rc=256} 16:10:29.177603 --- ParallelTerminationStrategy: PID 22924 died... 16:10:29.196400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22924): Terminated: ok {rc=0} 16:10:29.240850 --- ParallelTerminationStrategy: PID 22927 died... 16:10:29.259909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22927): Terminated: ok {rc=0} 16:10:29.304390 --- ParallelTerminationStrategy: PID 22930 died... 16:10:29.323130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22930): Terminated: ok {rc=0} 16:10:29.406909 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:10:30.554353 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:30.566703 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:10:30.641686 tst iperf3m4.py: using LAC 29107 16:10:30.767306 tst iperf3m4.py: using RAC 37 16:10:30.895205 tst iperf3m4.py: using CellId 29107 16:10:31.022264 tst iperf3m4.py: using BVCI 29108 16:10:31.140248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:31.152998 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:31.165459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:31.177537 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:31.190021 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:31.202528 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:31.215220 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:31.228459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:31.241275 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:31.359421 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:31.482977 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:31.598859 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:31.750147 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:10:32.004044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:32.313755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22932): Launched 16:10:32.581803 run iperf3-srv_10.42.42.10(pid=22933): Launched 16:10:32.693304 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:10:32.892839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:33.191287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22934): Launched 16:10:33.447852 run iperf3-srv_10.42.42.10(pid=22935): Launched 16:10:33.558734 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:10:33.756332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:34.052290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22936): Launched 16:10:34.309548 run iperf3-srv_10.42.42.10(pid=22937): Launched 16:10:34.420592 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:10:34.618882 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:34.916621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22938): Launched 16:10:35.173859 run iperf3-srv_10.42.42.10(pid=22939): Launched 16:10:35.284709 tst iperf3m4.py:8: start network... 16:10:35.482645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:35.940082 run create_hlr_db(pid=22940): Launched 16:10:36.052425 bus /gobi_6: Setting Powered False 16:10:37.111965 run create_hlr_db(pid=22940): Terminated: ok {rc=0} 16:10:37.544566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22942): Launched 16:10:37.840670 run osmo-hlr_10.42.42.2(pid=22943): Launched 16:10:37.952620 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:38.460449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22945): Launched 16:10:38.756101 run osmo-stp_10.42.42.5(pid=22946): Launched 16:10:38.868270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:39.377444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22948): Launched 16:10:39.490563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:39.740128 run patchelf(pid=22949): Launched 16:10:39.904157 run osmo-stp_10.42.42.5(pid=22946): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22946)] 16:10:40.030422 run osmo-stp_10.42.42.5(pid=22946): stdout: | (launched: 2022-12-10_16:10:38.701962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:40.158024 run osmo-stp_10.42.42.5(pid=22946): stderr: | [0;m[38;5;43m20221210161038868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161038868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161038868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161038869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161038869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161038869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161038869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:40.285971 run osmo-stp_10.42.42.5(pid=22946): stdout: | (launched: 2022-12-10_16:10:38.701962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:40.407423 run osmo-stp_10.42.42.5(pid=22946): stderr: | [0;m[38;5;43m20221210161038868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161038868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161038868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161038869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161038869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161038869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161038869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:40.551450 run patchelf(pid=22949): Terminating (SIGINT) 16:10:40.718060 run patchelf(pid=22949): Terminated: ok {rc=0} 16:10:40.838056 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22946): Process ended prematurely: osmo-stp_10.42.42.5(pid=22946) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22946)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:10:40.847466 tst iperf3m4.py:8: Test FAILED (10.3 sec) 16:10:40.875391 run osmo-hlr_10.42.42.2(pid=22943): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22943)] 16:10:40.923215 run osmo-hlr_10.42.42.2(pid=22943): stdout: | (launched: 2022-12-10_16:10:37.786763) 16:10:40.972804 run osmo-hlr_10.42.42.2(pid=22943): stderr: | [0;m[1;31m20221210161037957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161037957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161037957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161037957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161037957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161037957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161037971 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161037981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161037982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161037982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:41.023076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22932): Terminating (SIGTERM) 16:10:41.062946 run iperf3-srv_10.42.42.10(pid=22933): Terminating (SIGTERM) 16:10:41.102997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22934): Terminating (SIGTERM) 16:10:41.142858 run iperf3-srv_10.42.42.10(pid=22935): Terminating (SIGTERM) 16:10:41.182526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22936): Terminating (SIGTERM) 16:10:41.222349 run iperf3-srv_10.42.42.10(pid=22937): Terminating (SIGTERM) 16:10:41.261917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22938): Terminating (SIGTERM) 16:10:41.301584 run iperf3-srv_10.42.42.10(pid=22939): Terminating (SIGTERM) 16:10:41.341317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22942): Terminating (SIGTERM) 16:10:41.381506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22945): Terminating (SIGTERM) 16:10:41.421391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22948): Terminating (SIGTERM) 16:10:41.461371 --- ParallelTerminationStrategy: PID 22932 died... 16:10:41.480323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22932): Terminated: ok {rc=0} 16:10:41.524671 --- ParallelTerminationStrategy: PID 22933 died... 16:10:41.543061 run iperf3-srv_10.42.42.10(pid=22933): Terminated {rc=256} 16:10:41.586760 --- ParallelTerminationStrategy: PID 22934 died... 16:10:41.605184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22934): Terminated: ok {rc=0} 16:10:41.649326 --- ParallelTerminationStrategy: PID 22935 died... 16:10:41.667644 run iperf3-srv_10.42.42.10(pid=22935): Terminated {rc=256} 16:10:41.711195 --- ParallelTerminationStrategy: PID 22936 died... 16:10:41.729652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22936): Terminated: ok {rc=0} 16:10:41.773522 --- ParallelTerminationStrategy: PID 22937 died... 16:10:41.791735 run iperf3-srv_10.42.42.10(pid=22937): Terminated {rc=256} 16:10:41.835335 --- ParallelTerminationStrategy: PID 22938 died... 16:10:41.853914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22938): Terminated: ok {rc=0} 16:10:41.898126 --- ParallelTerminationStrategy: PID 22939 died... 16:10:41.916880 run iperf3-srv_10.42.42.10(pid=22939): Terminated {rc=256} 16:10:41.961194 --- ParallelTerminationStrategy: PID 22942 died... 16:10:41.979455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22942): Terminated: ok {rc=0} 16:10:42.023461 --- ParallelTerminationStrategy: PID 22945 died... 16:10:42.041823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22945): Terminated: ok {rc=0} 16:10:42.085858 --- ParallelTerminationStrategy: PID 22948 died... 16:10:42.104475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22948): Terminated: ok {rc=0} 16:10:42.188165 bus /gobi_4: Setting Powered False 16:10:43.285837 bus /gobi_4: Setting Powered False 16:10:44.403374 bus /gobi_1: Setting Powered False 16:10:45.502413 bus /gobi_1: Setting Powered False 16:10:46.621361 bus /gobi_0: Setting Powered False 16:10:47.720697 bus /gobi_0: Setting Powered False 16:10:48.840793 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:10:49.945259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:49.957373 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:10:50.030181 tst ping.py: using LAC 29108 16:10:50.154150 tst ping.py: using RAC 38 16:10:50.277583 tst ping.py: using CellId 29108 16:10:50.401090 tst ping.py: using BVCI 29109 16:10:50.513620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.525103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.536440 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.547848 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.559147 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.570497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.581914 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.593592 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:50.705846 tst ping.py:19: start network... 16:10:50.899787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:51.347617 run create_hlr_db(pid=22950): Launched 16:10:51.458395 bus /gobi_6: Setting Powered False 16:10:52.516690 run create_hlr_db(pid=22950): Terminated: ok {rc=0} 16:10:52.943217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22952): Launched 16:10:53.252813 run osmo-hlr_10.42.42.2(pid=22953): Launched 16:10:53.371092 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:53.909195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22955): Launched 16:10:54.218485 run osmo-stp_10.42.42.5(pid=22956): Launched 16:10:54.336195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:54.873147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22958): Launched 16:10:54.991304 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:55.254133 run patchelf(pid=22959): Launched 16:10:55.426170 run osmo-stp_10.42.42.5(pid=22956): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22956)] 16:10:55.557861 run osmo-stp_10.42.42.5(pid=22956): stdout: | (launched: 2022-12-10_16:10:54.162365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:55.691856 run osmo-stp_10.42.42.5(pid=22956): stderr: | [0;m[38;5;43m20221210161054353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161054353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161054353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161054354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161054354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161054354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161054354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:55.825439 run osmo-stp_10.42.42.5(pid=22956): stdout: | (launched: 2022-12-10_16:10:54.162365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:55.953220 run osmo-stp_10.42.42.5(pid=22956): stderr: | [0;m[38;5;43m20221210161054353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161054353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161054353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161054354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161054354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161054354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161054354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:56.104519 run patchelf(pid=22959): Terminating (SIGINT) 16:10:56.278863 run patchelf(pid=22959): Terminated: ok {rc=0} 16:10:56.404614 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22956): Process ended prematurely: osmo-stp_10.42.42.5(pid=22956) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22956)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 16:10:56.414036 tst ping.py:22: Test FAILED (6.5 sec) 16:10:56.441964 run osmo-hlr_10.42.42.2(pid=22953): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22953)] 16:10:56.492098 run osmo-hlr_10.42.42.2(pid=22953): stdout: | (launched: 2022-12-10_16:10:53.196694) 16:10:56.543852 run osmo-hlr_10.42.42.2(pid=22953): stderr: | [0;m[1;31m20221210161053392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161053392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161053392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161053392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161053392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161053392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161053407 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161053415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161053415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161053415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:56.596304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22952): Terminating (SIGTERM) 16:10:56.638482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22955): Terminating (SIGTERM) 16:10:56.680830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22958): Terminating (SIGTERM) 16:10:56.723186 --- ParallelTerminationStrategy: PID 22952 died... 16:10:56.743399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22952): Terminated: ok {rc=0} 16:10:56.790419 --- ParallelTerminationStrategy: PID 22955 died... 16:10:56.810414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22955): Terminated: ok {rc=0} 16:10:56.856829 --- ParallelTerminationStrategy: PID 22958 died... 16:10:56.877045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22958): Terminated: ok {rc=0} 16:10:56.965544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:10:58.054712 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:58.066822 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:10:58.139034 tst ping_idle_ping.py: using LAC 29109 16:10:58.254314 tst ping_idle_ping.py: using RAC 39 16:10:58.370744 tst ping_idle_ping.py: using CellId 29109 16:10:58.486411 tst ping_idle_ping.py: using BVCI 29110 16:10:58.592260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:58.603427 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:58.614233 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:58.625345 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:58.636193 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:58.647303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:58.658444 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:58.669469 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:58.786495 tst ping_idle_ping.py:24: start network... 16:10:58.997184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:59.488500 run create_hlr_db(pid=22960): Launched 16:10:59.615499 bus /gobi_6: Setting Powered False 16:11:00.677616 run create_hlr_db(pid=22960): Terminated: ok {rc=0} 16:11:01.155258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22962): Launched 16:11:01.504292 run osmo-hlr_10.42.42.2(pid=22963): Launched 16:11:01.620787 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:02.372490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22965): Launched 16:11:02.682017 run osmo-stp_10.42.42.5(pid=22966): Launched 16:11:02.799440 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:03.336152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22968): Launched 16:11:03.454518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:03.717527 run patchelf(pid=22969): Launched 16:11:03.890521 run osmo-stp_10.42.42.5(pid=22966): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22966)] 16:11:04.022676 run osmo-stp_10.42.42.5(pid=22966): stdout: | (launched: 2022-12-10_16:11:02.625645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:04.156094 run osmo-stp_10.42.42.5(pid=22966): stderr: | [0;m[38;5;43m20221210161102819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161102819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161102820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161102820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161102821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161102821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161102821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:04.290078 run osmo-stp_10.42.42.5(pid=22966): stdout: | (launched: 2022-12-10_16:11:02.625645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:04.418122 run osmo-stp_10.42.42.5(pid=22966): stderr: | [0;m[38;5;43m20221210161102819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161102819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161102820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161102820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161102821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161102821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161102821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:04.569891 run patchelf(pid=22969): Terminating (SIGINT) 16:11:04.744518 run patchelf(pid=22969): Terminated: ok {rc=0} 16:11:04.870519 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22966): Process ended prematurely: osmo-stp_10.42.42.5(pid=22966) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22966)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:11:04.879876 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:11:04.907671 run osmo-hlr_10.42.42.2(pid=22963): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22963)] 16:11:04.957331 run osmo-hlr_10.42.42.2(pid=22963): stdout: | (launched: 2022-12-10_16:11:01.449894) 16:11:05.008730 run osmo-hlr_10.42.42.2(pid=22963): stderr: | [0;m[1;31m20221210161101819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161101819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161101819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161101819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161101819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161101819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161101838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161101846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161101846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161101846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:05.060477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22962): Terminating (SIGTERM) 16:11:05.102180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22965): Terminating (SIGTERM) 16:11:05.143848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22968): Terminating (SIGTERM) 16:11:05.185505 --- ParallelTerminationStrategy: PID 22962 died... 16:11:05.205630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22962): Terminated: ok {rc=0} 16:11:05.251980 --- ParallelTerminationStrategy: PID 22965 died... 16:11:05.271398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22965): Terminated: ok {rc=0} 16:11:05.317433 --- ParallelTerminationStrategy: PID 22968 died... 16:11:05.336906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22968): Terminated: ok {rc=0} 16:11:05.424068 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:11:06.727090 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:11:06.733517 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:11:06.767565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:11:06.805883 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:11:06.891516 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:11:06.924817 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:11:06.962615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:11:07.558897 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:11:07.607066 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:07.618125 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:07.687931 tst cs_paging_gprs_active.py: using LAC 29110 16:11:07.805569 tst cs_paging_gprs_active.py: using RAC 40 16:11:07.930875 tst cs_paging_gprs_active.py: using CellId 29110 16:11:08.054858 tst cs_paging_gprs_active.py: using BVCI 29111 16:11:08.170144 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.181741 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.193214 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.205167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.218273 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.229886 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.241418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.252639 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.264237 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:08.384574 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:08.502998 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:11:08.719548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:09.038947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22973): Launched 16:11:09.316671 run iperf3-srv_10.42.42.10(pid=22974): Launched 16:11:09.435710 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:11:09.651173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:09.970390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22975): Launched 16:11:10.246786 run iperf3-srv_10.42.42.10(pid=22976): Launched 16:11:10.365596 tst cs_paging_gprs_active.py:38: start network... 16:11:10.580603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:11.071791 run create_hlr_db(pid=22977): Launched 16:11:11.199363 bus /gobi_6: Setting Powered False 16:11:12.262052 run create_hlr_db(pid=22977): Terminated: ok {rc=0} 16:11:12.686807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22979): Launched 16:11:12.981418 run osmo-hlr_10.42.42.2(pid=22980): Launched 16:11:13.095092 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:13.608665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22982): Launched 16:11:13.904775 run osmo-stp_10.42.42.5(pid=22983): Launched 16:11:14.017342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:14.527199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22985): Launched 16:11:14.640226 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:14.889534 run patchelf(pid=22986): Launched 16:11:15.054251 run osmo-stp_10.42.42.5(pid=22983): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22983)] 16:11:15.180675 run osmo-stp_10.42.42.5(pid=22983): stdout: | (launched: 2022-12-10_16:11:13.851019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:15.309455 run osmo-stp_10.42.42.5(pid=22983): stderr: | [0;m[38;5;43m20221210161114016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161114016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161114016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161114017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161114017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161114017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161114018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:15.437406 run osmo-stp_10.42.42.5(pid=22983): stdout: | (launched: 2022-12-10_16:11:13.851019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:15.558886 run osmo-stp_10.42.42.5(pid=22983): stderr: | [0;m[38;5;43m20221210161114016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161114016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161114016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161114017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161114017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161114017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161114018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:15.702964 run patchelf(pid=22986): Terminating (SIGINT) 16:11:15.884845 run patchelf(pid=22986): Terminated: ok {rc=0} 16:11:16.026449 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22983): Process ended prematurely: osmo-stp_10.42.42.5(pid=22983) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22983)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:11:16.044073 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:11:16.074363 run osmo-hlr_10.42.42.2(pid=22980): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22980)] 16:11:16.126897 run osmo-hlr_10.42.42.2(pid=22980): stdout: | (launched: 2022-12-10_16:11:12.927772) 16:11:16.180435 run osmo-hlr_10.42.42.2(pid=22980): stderr: | [0;m[1;31m20221210161113102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161113102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161113102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161113102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161113102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161113102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161113114 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161113123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161113123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161113123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:16.235756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22973): Terminating (SIGTERM) 16:11:16.280466 run iperf3-srv_10.42.42.10(pid=22974): Terminating (SIGTERM) 16:11:16.329249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22975): Terminating (SIGTERM) 16:11:16.374977 run iperf3-srv_10.42.42.10(pid=22976): Terminating (SIGTERM) 16:11:16.420393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22979): Terminating (SIGTERM) 16:11:16.465561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22982): Terminating (SIGTERM) 16:11:16.511449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22985): Terminating (SIGTERM) 16:11:16.559823 --- ParallelTerminationStrategy: PID 22973 died... 16:11:16.583470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22973): Terminated: ok {rc=0} 16:11:16.639548 --- ParallelTerminationStrategy: PID 22974 died... 16:11:16.663121 run iperf3-srv_10.42.42.10(pid=22974): Terminated {rc=256} 16:11:16.719328 --- ParallelTerminationStrategy: PID 22975 died... 16:11:16.741034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22975): Terminated: ok {rc=0} 16:11:16.797831 --- ParallelTerminationStrategy: PID 22976 died... 16:11:16.822057 run iperf3-srv_10.42.42.10(pid=22976): Terminated {rc=256} 16:11:16.877622 --- ParallelTerminationStrategy: PID 22979 died... 16:11:16.901008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22979): Terminated: ok {rc=0} 16:11:16.954052 --- ParallelTerminationStrategy: PID 22982 died... 16:11:16.977474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22982): Terminated: ok {rc=0} 16:11:17.032914 --- ParallelTerminationStrategy: PID 22985 died... 16:11:17.056798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22985): Terminated: ok {rc=0} 16:11:17.160802 bus /gobi_0: Setting Powered False 16:11:18.267544 bus /gobi_0: Setting Powered False 16:11:19.383185 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:11:20.532425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:20.544696 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:20.621715 tst iperf3.py: using LAC 29111 16:11:20.749116 tst iperf3.py: using RAC 41 16:11:20.873005 tst iperf3.py: using CellId 29111 16:11:20.996908 tst iperf3.py: using BVCI 29112 16:11:21.113171 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.124632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.135922 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.147640 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.159355 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.171095 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.183008 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.194667 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.206522 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:21.322059 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:11:21.522040 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:21.820306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22987): Launched 16:11:22.078558 run iperf3-srv_10.42.42.10(pid=22988): Launched 16:11:22.189663 tst iperf3.py:8: start network... 16:11:22.388578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:22.845561 run create_hlr_db(pid=22989): Launched 16:11:22.958301 bus /gobi_6: Setting Powered False 16:11:24.017600 run create_hlr_db(pid=22989): Terminated: ok {rc=0} 16:11:24.451634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22991): Launched 16:11:24.768417 run osmo-hlr_10.42.42.2(pid=22992): Launched 16:11:24.888628 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:25.434188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22994): Launched 16:11:25.750674 run osmo-stp_10.42.42.5(pid=22995): Launched 16:11:25.871001 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:26.416478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22997): Launched 16:11:26.536861 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:26.803952 run patchelf(pid=22998): Launched 16:11:26.979361 run osmo-stp_10.42.42.5(pid=22995): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22995)] 16:11:27.113668 run osmo-stp_10.42.42.5(pid=22995): stdout: | (launched: 2022-12-10_16:11:25.693192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:27.249949 run osmo-stp_10.42.42.5(pid=22995): stderr: | [0;m[38;5;43m20221210161125884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161125884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161125884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161125885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161125885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161125885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161125885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:27.386255 run osmo-stp_10.42.42.5(pid=22995): stdout: | (launched: 2022-12-10_16:11:25.693192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:27.516561 run osmo-stp_10.42.42.5(pid=22995): stderr: | [0;m[38;5;43m20221210161125884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161125884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161125884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161125885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161125885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161125885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161125885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:27.671244 run patchelf(pid=22998): Terminating (SIGINT) 16:11:27.848647 run patchelf(pid=22998): Terminated: ok {rc=0} 16:11:27.976804 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22995): Process ended prematurely: osmo-stp_10.42.42.5(pid=22995) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22995)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 16:11:27.986822 tst iperf3.py:8: Test FAILED (7.5 sec) 16:11:28.015363 run osmo-hlr_10.42.42.2(pid=22992): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22992)] 16:11:28.065352 run osmo-hlr_10.42.42.2(pid=22992): stdout: | (launched: 2022-12-10_16:11:24.711394) 16:11:28.117270 run osmo-hlr_10.42.42.2(pid=22992): stderr: | [0;m[1;31m20221210161124911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161124911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161124911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161124911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161124911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161124912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161124923 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161124933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161124934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161124934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:28.169428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22987): Terminating (SIGTERM) 16:11:28.211187 run iperf3-srv_10.42.42.10(pid=22988): Terminating (SIGTERM) 16:11:28.253056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22991): Terminating (SIGTERM) 16:11:28.294913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22994): Terminating (SIGTERM) 16:11:28.336861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22997): Terminating (SIGTERM) 16:11:28.379189 --- ParallelTerminationStrategy: PID 22987 died... 16:11:28.399301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22987): Terminated: ok {rc=0} 16:11:28.445955 --- ParallelTerminationStrategy: PID 22988 died... 16:11:28.465585 run iperf3-srv_10.42.42.10(pid=22988): Terminated {rc=256} 16:11:28.511769 --- ParallelTerminationStrategy: PID 22991 died... 16:11:28.531358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22991): Terminated: ok {rc=0} 16:11:28.577738 --- ParallelTerminationStrategy: PID 22994 died... 16:11:28.597531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22994): Terminated: ok {rc=0} 16:11:28.644089 --- ParallelTerminationStrategy: PID 22997 died... 16:11:28.663937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22997): Terminated: ok {rc=0} 16:11:28.753117 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:11:29.902662 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:29.914864 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:29.989096 tst iperf3m4.py: using LAC 29112 16:11:30.112479 tst iperf3m4.py: using RAC 42 16:11:30.236121 tst iperf3m4.py: using CellId 29112 16:11:30.360858 tst iperf3m4.py: using BVCI 29113 16:11:30.475031 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:30.486529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:30.497783 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:30.509108 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:30.520258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:30.531487 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:30.542844 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:30.554051 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:30.565532 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:30.683848 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:30.801637 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:30.945347 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:31.088772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:11:31.294748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:31.616854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22999): Launched 16:11:31.893706 run iperf3-srv_10.42.42.10(pid=23000): Launched 16:11:32.018251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:11:32.222423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:32.523309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23001): Launched 16:11:32.781102 run iperf3-srv_10.42.42.10(pid=23002): Launched 16:11:32.891991 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:11:33.090045 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:33.386442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23003): Launched 16:11:33.644403 run iperf3-srv_10.42.42.10(pid=23004): Launched 16:11:33.755335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:11:33.952734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:34.249695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23005): Launched 16:11:34.507285 run iperf3-srv_10.42.42.10(pid=23006): Launched 16:11:34.618237 tst iperf3m4.py:8: start network... 16:11:34.816725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:35.275557 run create_hlr_db(pid=23007): Launched 16:11:35.388802 bus /gobi_6: Setting Powered False 16:11:36.448409 run create_hlr_db(pid=23007): Terminated: ok {rc=0} 16:11:36.882877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23009): Launched 16:11:37.198761 run osmo-hlr_10.42.42.2(pid=23010): Launched 16:11:37.319157 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:37.865098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23012): Launched 16:11:38.180852 run osmo-stp_10.42.42.5(pid=23013): Launched 16:11:38.300169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:38.846313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23015): Launched 16:11:38.967132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:39.234243 run patchelf(pid=23016): Launched 16:11:39.409815 run osmo-stp_10.42.42.5(pid=23013): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23013)] 16:11:39.544636 run osmo-stp_10.42.42.5(pid=23013): stdout: | (launched: 2022-12-10_16:11:38.123512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:39.681627 run osmo-stp_10.42.42.5(pid=23013): stderr: | [0;m[38;5;43m20221210161138311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161138311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161138311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161138312 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161138312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161138312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161138312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:39.817928 run osmo-stp_10.42.42.5(pid=23013): stdout: | (launched: 2022-12-10_16:11:38.123512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:39.947935 run osmo-stp_10.42.42.5(pid=23013): stderr: | [0;m[38;5;43m20221210161138311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161138311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161138311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161138312 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161138312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161138312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161138312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:40.102328 run patchelf(pid=23016): Terminating (SIGINT) 16:11:40.280274 run patchelf(pid=23016): Terminated: ok {rc=0} 16:11:40.408586 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23013): Process ended prematurely: osmo-stp_10.42.42.5(pid=23013) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23013)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:11:40.418836 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:11:40.447617 run osmo-hlr_10.42.42.2(pid=23010): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23010)] 16:11:40.497759 run osmo-hlr_10.42.42.2(pid=23010): stdout: | (launched: 2022-12-10_16:11:37.141420) 16:11:40.549644 run osmo-hlr_10.42.42.2(pid=23010): stderr: | [0;m[1;31m20221210161137335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161137335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161137335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161137335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161137335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161137335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161137351 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161137360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161137361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161137361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:40.602069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22999): Terminating (SIGTERM) 16:11:40.644606 run iperf3-srv_10.42.42.10(pid=23000): Terminating (SIGTERM) 16:11:40.687008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23001): Terminating (SIGTERM) 16:11:40.729313 run iperf3-srv_10.42.42.10(pid=23002): Terminating (SIGTERM) 16:11:40.771469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23003): Terminating (SIGTERM) 16:11:40.813673 run iperf3-srv_10.42.42.10(pid=23004): Terminating (SIGTERM) 16:11:40.855925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23005): Terminating (SIGTERM) 16:11:40.898003 run iperf3-srv_10.42.42.10(pid=23006): Terminating (SIGTERM) 16:11:40.939889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23009): Terminating (SIGTERM) 16:11:40.981869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23012): Terminating (SIGTERM) 16:11:41.023794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23015): Terminating (SIGTERM) 16:11:41.066177 --- ParallelTerminationStrategy: PID 22999 died... 16:11:41.086332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22999): Terminated: ok {rc=0} 16:11:41.133310 --- ParallelTerminationStrategy: PID 23000 died... 16:11:41.152921 run iperf3-srv_10.42.42.10(pid=23000): Terminated {rc=256} 16:11:41.199231 --- ParallelTerminationStrategy: PID 23001 died... 16:11:41.219022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23001): Terminated: ok {rc=0} 16:11:41.265610 --- ParallelTerminationStrategy: PID 23002 died... 16:11:41.285262 run iperf3-srv_10.42.42.10(pid=23002): Terminated {rc=256} 16:11:41.331670 --- ParallelTerminationStrategy: PID 23003 died... 16:11:41.351428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23003): Terminated: ok {rc=0} 16:11:41.397894 --- ParallelTerminationStrategy: PID 23004 died... 16:11:41.417606 run iperf3-srv_10.42.42.10(pid=23004): Terminated {rc=256} 16:11:41.464078 --- ParallelTerminationStrategy: PID 23005 died... 16:11:41.483976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23005): Terminated: ok {rc=0} 16:11:41.530803 --- ParallelTerminationStrategy: PID 23006 died... 16:11:41.550359 run iperf3-srv_10.42.42.10(pid=23006): Terminated {rc=256} 16:11:41.596769 --- ParallelTerminationStrategy: PID 23009 died... 16:11:41.617100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23009): Terminated: ok {rc=0} 16:11:41.663541 --- ParallelTerminationStrategy: PID 23012 died... 16:11:41.683331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23012): Terminated: ok {rc=0} 16:11:41.729785 --- ParallelTerminationStrategy: PID 23015 died... 16:11:41.749596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23015): Terminated: ok {rc=0} 16:11:41.837337 bus /gobi_4: Setting Powered False 16:11:42.936460 bus /gobi_4: Setting Powered False 16:11:44.053412 bus /gobi_1: Setting Powered False 16:11:45.152121 bus /gobi_1: Setting Powered False 16:11:46.267511 bus /gobi_0: Setting Powered False 16:11:47.366977 bus /gobi_0: Setting Powered False 16:11:48.480787 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:11:49.584120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:49.596523 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:49.670558 tst ping.py: using LAC 29113 16:11:49.787347 tst ping.py: using RAC 43 16:11:49.902797 tst ping.py: using CellId 29113 16:11:50.018972 tst ping.py: using BVCI 29114 16:11:50.123575 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:50.134682 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:50.145615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:50.156604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:50.167621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:50.178877 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:50.190044 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:50.201135 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:50.317631 tst ping.py:19: start network... 16:11:50.526319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:51.005683 run create_hlr_db(pid=23017): Launched 16:11:51.131601 bus /gobi_6: Setting Powered False 16:11:52.194268 run create_hlr_db(pid=23017): Terminated: ok {rc=0} 16:11:52.610156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23019): Launched 16:11:52.900212 run osmo-hlr_10.42.42.2(pid=23020): Launched 16:11:53.010658 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:53.517888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23022): Launched 16:11:53.808395 run osmo-stp_10.42.42.5(pid=23023): Launched 16:11:53.918802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:54.422434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23025): Launched 16:11:54.534010 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:54.778907 run patchelf(pid=23026): Launched 16:11:54.939959 run osmo-stp_10.42.42.5(pid=23023): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23023)] 16:11:55.063222 run osmo-stp_10.42.42.5(pid=23023): stdout: | (launched: 2022-12-10_16:11:53.755004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:55.187943 run osmo-stp_10.42.42.5(pid=23023): stderr: | [0;m[38;5;43m20221210161153925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161153925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161153925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161153926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161153928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161153928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161153928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:55.313189 run osmo-stp_10.42.42.5(pid=23023): stdout: | (launched: 2022-12-10_16:11:53.755004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:55.432007 run osmo-stp_10.42.42.5(pid=23023): stderr: | [0;m[38;5;43m20221210161153925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161153925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161153925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161153926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161153928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161153928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161153928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:55.573250 run patchelf(pid=23026): Terminating (SIGINT) 16:11:55.736365 run patchelf(pid=23026): Terminated: ok {rc=0} 16:11:55.854411 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23023): Process ended prematurely: osmo-stp_10.42.42.5(pid=23023) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23023)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 16:11:55.863095 tst ping.py:22: Test FAILED (6.3 sec) 16:11:55.890031 run osmo-hlr_10.42.42.2(pid=23020): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23020)] 16:11:55.938355 run osmo-hlr_10.42.42.2(pid=23020): stdout: | (launched: 2022-12-10_16:11:52.847033) 16:11:55.988104 run osmo-hlr_10.42.42.2(pid=23020): stderr: | [0;m[1;31m20221210161153023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161153024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161153024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161153024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161153024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161153024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161153035 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161153044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161153044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161153044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:56.038096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23019): Terminating (SIGTERM) 16:11:56.078646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23022): Terminating (SIGTERM) 16:11:56.118914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23025): Terminating (SIGTERM) 16:11:56.159356 --- ParallelTerminationStrategy: PID 23019 died... 16:11:56.178487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23019): Terminated: ok {rc=0} 16:11:56.223221 --- ParallelTerminationStrategy: PID 23022 died... 16:11:56.241956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23022): Terminated: ok {rc=0} 16:11:56.286295 --- ParallelTerminationStrategy: PID 23025 died... 16:11:56.304881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23025): Terminated: ok {rc=0} 16:11:56.389342 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:11:57.477348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:57.490035 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:57.564138 tst ping_idle_ping.py: using LAC 29114 16:11:57.690048 tst ping_idle_ping.py: using RAC 44 16:11:57.813104 tst ping_idle_ping.py: using CellId 29114 16:11:57.929357 tst ping_idle_ping.py: using BVCI 29115 16:11:58.035973 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:58.047053 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:58.057917 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:58.069124 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:58.080083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:58.091847 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:58.103017 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:58.114067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:58.230355 tst ping_idle_ping.py:24: start network... 16:11:58.440667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:58.926813 run create_hlr_db(pid=23027): Launched 16:11:59.054013 bus /gobi_6: Setting Powered False 16:12:00.116692 run create_hlr_db(pid=23027): Terminated: ok {rc=0} 16:12:00.535267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23029): Launched 16:12:00.827038 run osmo-hlr_10.42.42.2(pid=23030): Launched 16:12:01.007423 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:01.686920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23032): Launched 16:12:02.011528 run osmo-stp_10.42.42.5(pid=23033): Launched 16:12:02.216523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:02.782280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23035): Launched 16:12:02.893165 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:03.138807 run patchelf(pid=23036): Launched 16:12:03.300431 run osmo-stp_10.42.42.5(pid=23033): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23033)] 16:12:03.424027 run osmo-stp_10.42.42.5(pid=23033): stdout: | (launched: 2022-12-10_16:12:01.948475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:03.549659 run osmo-stp_10.42.42.5(pid=23033): stderr: | [0;m[38;5;43m20221210161202246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161202246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161202246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161202247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161202247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161202247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161202247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:03.675585 run osmo-stp_10.42.42.5(pid=23033): stdout: | (launched: 2022-12-10_16:12:01.948475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:03.795369 run osmo-stp_10.42.42.5(pid=23033): stderr: | [0;m[38;5;43m20221210161202246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161202246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161202246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161202247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161202247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161202247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161202247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:03.937503 run patchelf(pid=23036): Terminating (SIGINT) 16:12:04.100917 run patchelf(pid=23036): Terminated: ok {rc=0} 16:12:04.219062 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23033): Process ended prematurely: osmo-stp_10.42.42.5(pid=23033) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23033)] [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:12:04.227855 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:12:04.254734 run osmo-hlr_10.42.42.2(pid=23030): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23030)] 16:12:04.302600 run osmo-hlr_10.42.42.2(pid=23030): stdout: | (launched: 2022-12-10_16:12:00.773794) 16:12:04.351750 run osmo-hlr_10.42.42.2(pid=23030): stderr: | [0;m[1;31m20221210161201105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161201105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161201105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161201105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161201105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161201105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161201126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161201138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161201139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161201139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:04.401213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23029): Terminating (SIGTERM) 16:12:04.441176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23032): Terminating (SIGTERM) 16:12:04.480893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23035): Terminating (SIGTERM) 16:12:04.520897 --- ParallelTerminationStrategy: PID 23029 died... 16:12:04.539892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23029): Terminated: ok {rc=0} 16:12:04.584081 --- ParallelTerminationStrategy: PID 23032 died... 16:12:04.602620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23032): Terminated: ok {rc=0} 16:12:04.646693 --- ParallelTerminationStrategy: PID 23035 died... 16:12:04.665122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23035): Terminated: ok {rc=0} 16:12:04.750196 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:12:06.055289 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:06.062137 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:12:06.096116 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:12:06.130147 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:12:06.183636 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:12:06.217023 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:12:06.250970 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:12:06.810126 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:12:06.815396 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:06.826820 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:12:06.898386 tst switch_tch_pdch.py: using LAC 29115 16:12:07.013127 tst switch_tch_pdch.py: using RAC 45 16:12:07.127593 tst switch_tch_pdch.py: using CellId 29115 16:12:07.241907 tst switch_tch_pdch.py: using BVCI 29116 16:12:07.349553 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:07.360734 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:07.371815 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:07.383645 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:07.395574 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:07.407389 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:07.419509 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:07.431369 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:12:07.551521 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:12:07.666226 tst switch_tch_pdch.py:51: start network... 16:12:07.861810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:08.311980 run create_hlr_db(pid=23042): Launched 16:12:08.422490 bus /gobi_6: Setting Powered False 16:12:09.481846 run create_hlr_db(pid=23042): Terminated: ok {rc=0} 16:12:09.890627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23044): Launched 16:12:10.181072 run osmo-hlr_10.42.42.2(pid=23045): Launched 16:12:10.291711 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:10.807018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23047): Launched 16:12:11.095353 run osmo-stp_10.42.42.5(pid=23048): Launched 16:12:11.205880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:11.705041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23050): Launched 16:12:11.816574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:12.060890 run patchelf(pid=23051): Launched 16:12:12.221367 run osmo-stp_10.42.42.5(pid=23048): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23048)] 16:12:12.344012 run osmo-stp_10.42.42.5(pid=23048): stdout: | (launched: 2022-12-10_16:12:11.042786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:12.468915 run osmo-stp_10.42.42.5(pid=23048): stderr: | [0;m[38;5;43m20221210161211209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161211209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161211209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161211209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161211210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161211210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161211210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:12.593520 run osmo-stp_10.42.42.5(pid=23048): stdout: | (launched: 2022-12-10_16:12:11.042786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:12.712225 run osmo-stp_10.42.42.5(pid=23048): stderr: | [0;m[38;5;43m20221210161211209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161211209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161211209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161211209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161211210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161211210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161211210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:12.853197 run patchelf(pid=23051): Terminating (SIGINT) 16:12:13.015597 run patchelf(pid=23051): Terminated: ok {rc=0} 16:12:13.132719 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23048): Process ended prematurely: osmo-stp_10.42.42.5(pid=23048) [trial-2376↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23048)] [trial-2376↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:12:13.141659 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 16:12:13.168509 run osmo-hlr_10.42.42.2(pid=23045): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23045)] 16:12:13.216129 run osmo-hlr_10.42.42.2(pid=23045): stdout: | (launched: 2022-12-10_16:12:10.127780) 16:12:13.265382 run osmo-hlr_10.42.42.2(pid=23045): stderr: | [0;m[1;31m20221210161210302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161210302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161210302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161210302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161210302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161210302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161210315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161210323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161210323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161210323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:13.315093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23044): Terminating (SIGTERM) 16:12:13.354848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23047): Terminating (SIGTERM) 16:12:13.394530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23050): Terminating (SIGTERM) 16:12:13.434302 --- ParallelTerminationStrategy: PID 23044 died... 16:12:13.453092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23044): Terminated: ok {rc=0} 16:12:13.497192 --- ParallelTerminationStrategy: PID 23047 died... 16:12:13.515691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23047): Terminated: ok {rc=0} 16:12:13.559657 --- ParallelTerminationStrategy: PID 23050 died... 16:12:13.578023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23050): Terminated: ok {rc=0} 16:12:13.661345 bus /gobi_0: Setting Powered False 16:12:14.757521 bus /gobi_0: Setting Powered False 16:12:15.872752 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:12:17.143612 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:17.150033 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:12:17.187962 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:12:17.224367 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:12:17.279183 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:12:17.313365 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:12:17.347885 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:12:17.907435 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:12:17.913757 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:17.925298 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:12:18.000318 tst switch_tch_pdch.py: using LAC 29116 16:12:18.121404 tst switch_tch_pdch.py: using RAC 46 16:12:18.241589 tst switch_tch_pdch.py: using CellId 29116 16:12:18.362236 tst switch_tch_pdch.py: using BVCI 29117 16:12:18.475165 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:18.486807 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:18.498087 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:18.509502 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:18.520884 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:18.532534 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:18.543953 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:18.555335 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:12:18.670135 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:12:18.782607 tst switch_tch_pdch.py:51: start network... 16:12:18.978175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:19.405081 run create_hlr_db(pid=23055): Launched 16:12:19.517302 bus /gobi_6: Setting Powered False 16:12:20.576127 run create_hlr_db(pid=23055): Terminated: ok {rc=0} 16:12:20.978111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23057): Launched 16:12:21.288909 run osmo-hlr_10.42.42.2(pid=23058): Launched 16:12:21.407982 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:21.922729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23060): Launched 16:12:22.231819 run osmo-stp_10.42.42.5(pid=23061): Launched 16:12:22.349576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:22.860003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23063): Launched 16:12:22.978903 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:23.240865 run patchelf(pid=23064): Launched 16:12:23.413115 run osmo-stp_10.42.42.5(pid=23061): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23061)] 16:12:23.544494 run osmo-stp_10.42.42.5(pid=23061): stdout: | (launched: 2022-12-10_16:12:22.175195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:23.678049 run osmo-stp_10.42.42.5(pid=23061): stderr: | [0;m[38;5;43m20221210161222363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161222363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161222363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161222364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161222366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161222366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161222366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:23.811676 run osmo-stp_10.42.42.5(pid=23061): stdout: | (launched: 2022-12-10_16:12:22.175195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:23.939417 run osmo-stp_10.42.42.5(pid=23061): stderr: | [0;m[38;5;43m20221210161222363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161222363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161222363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161222364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161222366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161222366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161222366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:24.090478 run patchelf(pid=23064): Terminating (SIGINT) 16:12:24.264299 run patchelf(pid=23064): Terminated: ok {rc=0} 16:12:24.390052 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23061): Process ended prematurely: osmo-stp_10.42.42.5(pid=23061) [trial-2376↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23061)] [trial-2376↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:12:24.399376 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:12:24.427079 run osmo-hlr_10.42.42.2(pid=23058): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23058)] 16:12:24.476669 run osmo-hlr_10.42.42.2(pid=23058): stdout: | (launched: 2022-12-10_16:12:21.232493) 16:12:24.527952 run osmo-hlr_10.42.42.2(pid=23058): stderr: | [0;m[1;31m20221210161221431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161221431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161221431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161221431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161221431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161221431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161221444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161221452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161221452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161221452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:24.579659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23057): Terminating (SIGTERM) 16:12:24.621209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23060): Terminating (SIGTERM) 16:12:24.662985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23063): Terminating (SIGTERM) 16:12:24.704919 --- ParallelTerminationStrategy: PID 23057 died... 16:12:24.724819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23057): Terminated: ok {rc=0} 16:12:24.770729 --- ParallelTerminationStrategy: PID 23060 died... 16:12:24.790079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23060): Terminated: ok {rc=0} 16:12:24.835724 --- ParallelTerminationStrategy: PID 23063 died... 16:12:24.855136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23063): Terminated: ok {rc=0} 16:12:24.942678 bus /gobi_0: Setting Powered False 16:12:26.041648 bus /gobi_0: Setting Powered False 16:12:27.157443 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_sms:trx-umtrx --------------------------------------------------------------------- 16:12:28.408750 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:28.412434 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:12:28.445295 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 16:12:28.451943 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 16:12:28.502989 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:12:28.534836 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 16:12:28.541413 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 16:12:29.078831 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 16:12:29.083626 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 16:12:29.094208 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 16:12:29.140912 tst mo_mt_sms.py: using LAC 29117 16:12:29.256045 tst mo_mt_sms.py: using RAC 47 16:12:29.369352 tst mo_mt_sms.py: using CellId 29117 16:12:29.482987 tst mo_mt_sms.py: using BVCI 29118 16:12:29.587932 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:12:29.698451 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:12:29.811820 tst mo_mt_sms.py:9: start nitb and bts... 16:12:30.024854 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:12:30.661308 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23068): Launched 16:12:30.999939 run osmo-nitb_10.42.42.2(pid=23069): Launched 16:12:31.191731 run osmo-nitb_10.42.42.2(pid=23069): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23069)] 16:12:31.333940 run osmo-nitb_10.42.42.2(pid=23069): stdout: | (launched: 2022-12-10_16:12:30.938326) 16:12:31.478263 run osmo-nitb_10.42.42.2(pid=23069): stderr: | (launched: 2022-12-10_16:12:30.985608) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:12:31.622446 run osmo-nitb_10.42.42.2(pid=23069): stdout: | (launched: 2022-12-10_16:12:30.938326) 16:12:31.761803 run osmo-nitb_10.42.42.2(pid=23069): stderr: | (launched: 2022-12-10_16:12:30.985608) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23069): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23069) [trial-2376↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23069)] 16:12:32.135487 tst osmo-nitb_10.42.42.2(pid=23069): stdout: | (launched: 2022-12-10_16:12:30.938326) 16:12:32.263159 tst osmo-nitb_10.42.42.2(pid=23069): stderr: | (launched: 2022-12-10_16:12:30.985608) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:12:32.412439 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23069): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23069) [trial-2376↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23069)] [trial-2376↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 16:12:32.421649 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:12:32.428850 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23068): Terminating (SIGTERM) 16:12:32.639131 --- ParallelTerminationStrategy: PID 23068 died... 16:12:32.661042 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23068): Terminated: ok {rc=0} 16:12:32.748474 bus /sierra_3: Setting Powered False 16:12:33.850330 bus /sierra_3: Setting Powered False 16:12:34.967827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 sms:trx-umtrx --------------------------------------------------------------------- 16:12:36.167041 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:36.171415 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:12:36.204719 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:12:36.232264 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 16:12:36.285181 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:12:36.318023 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:12:36.345126 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 16:12:36.892324 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 16:12:36.897631 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:36.908595 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 16:12:36.956398 tst mo_mt_sms.py: using LAC 29118 16:12:37.081883 tst mo_mt_sms.py: using RAC 48 16:12:37.203384 tst mo_mt_sms.py: using CellId 29118 16:12:37.323507 tst mo_mt_sms.py: using BVCI 29119 16:12:37.435571 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:37.446659 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:37.457542 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:37.468303 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:37.479184 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:37.490039 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:12:37.604763 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:12:37.721968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:38.174417 run create_hlr_db(pid=23073): Launched 16:12:38.285970 bus /sierra_2: Setting Powered False 16:12:39.344294 run create_hlr_db(pid=23073): Terminated: ok {rc=0} 16:12:39.752341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23075): Launched 16:12:40.043147 run osmo-hlr_10.42.42.2(pid=23076): Launched 16:12:40.153982 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:40.653421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23078): Launched 16:12:40.945103 run osmo-stp_10.42.42.5(pid=23079): Launched 16:12:41.055751 run osmo-msc_10.42.42.6: Starting osmo-msc 16:12:41.581507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23081): Launched 16:12:41.872247 run osmo-msc_10.42.42.6(pid=23082): Launched 16:12:42.035398 run osmo-stp_10.42.42.5(pid=23079): ERR: Terminated: ERROR {rc=1} [trial-2376↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23079)] 16:12:42.162765 run osmo-stp_10.42.42.5(pid=23079): stdout: | (launched: 2022-12-10_16:12:40.891075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:42.286782 run osmo-stp_10.42.42.5(pid=23079): stderr: | [0;m[38;5;43m20221210161241059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161241059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161241059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161241060 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161241062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161241062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161241062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:42.407707 run osmo-stp_10.42.42.5(pid=23079): stdout: | (launched: 2022-12-10_16:12:40.891075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:42.523398 run osmo-stp_10.42.42.5(pid=23079): stderr: | [0;m[38;5;43m20221210161241059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161241059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161241059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161241060 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161241062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161241062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161241062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:42.661871 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23079): Process ended prematurely: osmo-stp_10.42.42.5(pid=23079) [trial-2376↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23079)] [trial-2376↪sms:trx-umtrx↪mo_mt_sms.py:16] 16:12:42.670176 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 16:12:42.696135 run osmo-hlr_10.42.42.2(pid=23076): ERR: Terminated: ERROR {rc=237} [trial-2376↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23076)] 16:12:42.743962 run osmo-hlr_10.42.42.2(pid=23076): stdout: | (launched: 2022-12-10_16:12:39.990434) 16:12:42.793298 run osmo-hlr_10.42.42.2(pid=23076): stderr: | [0;m[1;31m20221210161240164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161240164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161240164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161240164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161240164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161240164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161240175 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161240184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161240184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161240184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:42.862024 run osmo-msc_10.42.42.6(pid=23082): ERR: Terminated: ERROR {rc=2} [trial-2376↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23082)] 16:12:42.909417 run osmo-msc_10.42.42.6(pid=23082): stdout: | (launched: 2022-12-10_16:12:41.819045) 16:12:42.958350 run osmo-msc_10.42.42.6(pid=23082): stderr: | [0;m[38;5;43m20221210161242090 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161242090 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd48eb72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161242090 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161242090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161242090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161242091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161242092 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161242093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161242093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161242093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:12:43.007863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23075): Terminating (SIGTERM) 16:12:43.047591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23078): Terminating (SIGTERM) 16:12:43.087382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23081): Terminating (SIGTERM) 16:12:43.127402 --- ParallelTerminationStrategy: PID 23075 died... 16:12:43.146265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23075): Terminated: ok {rc=0} 16:12:43.190553 --- ParallelTerminationStrategy: PID 23078 died... 16:12:43.208876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23078): Terminated: ok {rc=0} 16:12:43.253460 --- ParallelTerminationStrategy: PID 23081 died... 16:12:43.271839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23081): Terminated: ok {rc=0} 16:12:43.356888 bus /sierra_3: Setting Powered False 16:12:44.454060 bus /sierra_3: Setting Powered False 16:12:45.568180 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 16:12:46.836220 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:46.840648 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:12:46.883081 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 16:12:46.891929 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 16:12:46.935480 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:12:46.970058 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 16:12:46.977853 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 16:12:47.492668 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2376 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 16:12:47.497965 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 16:12:47.508716 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 16:12:47.556139 tst assert_extension.py: using LAC 29119 16:12:47.669831 tst assert_extension.py: using RAC 49 16:12:47.791797 tst assert_extension.py: using CellId 29119 16:12:47.913512 tst assert_extension.py: using BVCI 29120 16:12:48.021538 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 16:12:48.133407 tst assert_extension.py:10: start nitb and bts... 16:12:48.327881 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:12:48.921634 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23087): Launched 16:12:49.211965 run osmo-nitb_10.42.42.2(pid=23088): Launched 16:12:49.372227 run osmo-nitb_10.42.42.2(pid=23088): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23088)] 16:12:49.502721 run osmo-nitb_10.42.42.2(pid=23088): stdout: | (launched: 2022-12-10_16:12:49.158829) 16:12:49.634808 run osmo-nitb_10.42.42.2(pid=23088): stderr: | (launched: 2022-12-10_16:12:49.201951) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:12:49.767593 run osmo-nitb_10.42.42.2(pid=23088): stdout: | (launched: 2022-12-10_16:12:49.158829) 16:12:49.894349 run osmo-nitb_10.42.42.2(pid=23088): stderr: | (launched: 2022-12-10_16:12:49.201951) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23088): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23088) [trial-2376↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23088)] 16:12:50.321549 tst osmo-nitb_10.42.42.2(pid=23088): stdout: | (launched: 2022-12-10_16:12:49.158829) 16:12:50.439351 tst osmo-nitb_10.42.42.2(pid=23088): stderr: | (launched: 2022-12-10_16:12:49.201951) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:12:50.578933 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23088): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23088) [trial-2376↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23088)] [trial-2376↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 16:12:50.587341 tst assert_extension.py:12: Test FAILED (3.1 sec) 16:12:50.593996 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23087): Terminating (SIGTERM) 16:12:50.803029 --- ParallelTerminationStrategy: PID 23087 died... 16:12:50.823806 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23087): Terminated: ok {rc=0} 16:12:50.909969 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 ussd:trx-umtrx --------------------------------------------------------------------- 16:12:52.086233 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:52.091050 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:12:52.124825 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:12:52.152082 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 16:12:52.187683 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:12:52.221260 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:12:52.248840 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 16:12:52.777207 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 16:12:52.782512 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:52.793692 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 16:12:52.841567 tst assert_extension.py: using LAC 29120 16:12:52.966158 tst assert_extension.py: using RAC 50 16:12:53.088807 tst assert_extension.py: using CellId 29120 16:12:53.210630 tst assert_extension.py: using BVCI 29121 16:12:53.322960 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:53.333992 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:53.344882 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:53.355876 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:53.367085 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:53.378139 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 16:12:53.490847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:53.940487 run create_hlr_db(pid=23092): Launched 16:12:54.051780 bus /sierra_2: Setting Powered False 16:12:55.110953 run create_hlr_db(pid=23092): Terminated: ok {rc=0} 16:12:55.538920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23094): Launched 16:12:55.853305 run osmo-hlr_10.42.42.2(pid=23095): Launched 16:12:55.971643 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:56.512487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23097): Launched 16:12:56.822770 run osmo-stp_10.42.42.5(pid=23098): Launched 16:12:56.940648 run osmo-msc_10.42.42.6: Starting osmo-msc 16:12:57.501164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23100): Launched 16:12:57.810787 run osmo-msc_10.42.42.6(pid=23101): Launched 16:12:57.982657 run osmo-stp_10.42.42.5(pid=23098): ERR: Terminated: ERROR {rc=1} [trial-2376↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23098)] 16:12:58.113382 run osmo-stp_10.42.42.5(pid=23098): stdout: | (launched: 2022-12-10_16:12:56.766371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:58.244479 run osmo-stp_10.42.42.5(pid=23098): stderr: | [0;m[38;5;43m20221210161256957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161256957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161256958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161256958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161256958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161256959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161256959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:58.375106 run osmo-stp_10.42.42.5(pid=23098): stdout: | (launched: 2022-12-10_16:12:56.766371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:58.499022 run osmo-stp_10.42.42.5(pid=23098): stderr: | [0;m[38;5;43m20221210161256957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161256957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161256958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161256958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161256958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161256959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161256959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:58.647132 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23098): Process ended prematurely: osmo-stp_10.42.42.5(pid=23098) [trial-2376↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23098)] [trial-2376↪ussd:trx-umtrx↪assert_extension.py:17] 16:12:58.655916 tst assert_extension.py:17: Test FAILED (5.9 sec) 16:12:58.683857 run osmo-hlr_10.42.42.2(pid=23095): ERR: Terminated: ERROR {rc=237} [trial-2376↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23095)] 16:12:58.734113 run osmo-hlr_10.42.42.2(pid=23095): stdout: | (launched: 2022-12-10_16:12:55.796829) 16:12:58.785753 run osmo-hlr_10.42.42.2(pid=23095): stderr: | [0;m[1;31m20221210161255992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161255993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161255993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161255993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161255993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161255993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161256006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161256014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161256014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161256014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:58.857391 run osmo-msc_10.42.42.6(pid=23101): ERR: Terminated: ERROR {rc=2} [trial-2376↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23101)] 16:12:58.907467 run osmo-msc_10.42.42.6(pid=23101): stdout: | (launched: 2022-12-10_16:12:57.754702) 16:12:58.958626 run osmo-msc_10.42.42.6(pid=23101): stderr: | [0;m[38;5;43m20221210161258074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161258074 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99570ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161258074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161258074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161258074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161258075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161258076 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161258077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161258077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161258077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:12:59.010221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23094): Terminating (SIGTERM) 16:12:59.052016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23097): Terminating (SIGTERM) 16:12:59.093698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23100): Terminating (SIGTERM) 16:12:59.135505 --- ParallelTerminationStrategy: PID 23094 died... 16:12:59.155468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23094): Terminated: ok {rc=0} 16:12:59.202055 --- ParallelTerminationStrategy: PID 23097 died... 16:12:59.221474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23097): Terminated: ok {rc=0} 16:12:59.267485 --- ParallelTerminationStrategy: PID 23100 died... 16:12:59.286941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23100): Terminated: ok {rc=0} 16:12:59.373639 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:13:00.584577 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:13:00.591684 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:13:00.625266 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:13:00.652894 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:13:00.707423 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:13:00.742082 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:13:00.769570 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:13:01.321963 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:13:01.391734 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:01.403408 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:13:01.473454 tst mo_mt_call.py: using LAC 29121 16:13:01.629886 tst mo_mt_call.py: using RAC 51 16:13:01.750965 tst mo_mt_call.py: using CellId 29121 16:13:01.911586 tst mo_mt_call.py: using BVCI 29122 16:13:02.030490 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:02.043029 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:02.055267 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:02.068269 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:02.081337 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:02.093995 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:13:02.218180 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:13:02.340851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:02.833260 run create_hlr_db(pid=23106): Launched 16:13:02.962126 bus /sierra_2: Setting Powered False 16:13:04.025478 run create_hlr_db(pid=23106): Terminated: ok {rc=0} 16:13:04.450848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23108): Launched 16:13:04.747074 run osmo-hlr_10.42.42.2(pid=23109): Launched 16:13:04.859093 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:05.380462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23111): Launched 16:13:05.676072 run osmo-stp_10.42.42.5(pid=23112): Launched 16:13:05.788709 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:06.323342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23114): Launched 16:13:06.618704 run osmo-msc_10.42.42.6(pid=23115): Launched 16:13:06.783795 run osmo-stp_10.42.42.5(pid=23112): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23112)] 16:13:06.909390 run osmo-stp_10.42.42.5(pid=23112): stdout: | (launched: 2022-12-10_16:13:05.622455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:07.035467 run osmo-stp_10.42.42.5(pid=23112): stderr: | [0;m[38;5;43m20221210161305792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161305792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161305792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161305792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161305793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161305793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161305793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:07.159173 run osmo-stp_10.42.42.5(pid=23112): stdout: | (launched: 2022-12-10_16:13:05.622455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:07.277430 run osmo-stp_10.42.42.5(pid=23112): stderr: | [0;m[38;5;43m20221210161305792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161305792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161305792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161305792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161305793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161305793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161305793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:07.418697 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23112): Process ended prematurely: osmo-stp_10.42.42.5(pid=23112) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23112)] [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:13:07.427477 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:13:07.454049 run osmo-hlr_10.42.42.2(pid=23109): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23109)] 16:13:07.502317 run osmo-hlr_10.42.42.2(pid=23109): stdout: | (launched: 2022-12-10_16:13:04.693389) 16:13:07.552062 run osmo-hlr_10.42.42.2(pid=23109): stderr: | [0;m[1;31m20221210161304868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161304868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161304868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161304868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161304868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161304868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161304879 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161304888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161304888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161304889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:07.621289 run osmo-msc_10.42.42.6(pid=23115): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23115)] 16:13:07.669194 run osmo-msc_10.42.42.6(pid=23115): stdout: | (launched: 2022-12-10_16:13:06.564783) 16:13:07.718687 run osmo-msc_10.42.42.6(pid=23115): stderr: | [0;m[38;5;43m20221210161306837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161306837 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4a3ed7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161306837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161306837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161306837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161306837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161306839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161306840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161306840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161306840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:07.768799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23108): Terminating (SIGTERM) 16:13:07.808673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23111): Terminating (SIGTERM) 16:13:07.848827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23114): Terminating (SIGTERM) 16:13:07.889131 --- ParallelTerminationStrategy: PID 23108 died... 16:13:07.908143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23108): Terminated: ok {rc=0} 16:13:07.953104 --- ParallelTerminationStrategy: PID 23111 died... 16:13:07.971621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23111): Terminated: ok {rc=0} 16:13:08.016576 --- ParallelTerminationStrategy: PID 23114 died... 16:13:08.035228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23114): Terminated: ok {rc=0} 16:13:08.121891 bus /sierra_3: Setting Powered False 16:13:09.219823 bus /sierra_3: Setting Powered False 16:13:10.333770 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:13:11.481482 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:11.493831 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:13:11.563809 tst mo_mt_call_osmux.py: using LAC 29122 16:13:11.687502 tst mo_mt_call_osmux.py: using RAC 52 16:13:11.811665 tst mo_mt_call_osmux.py: using CellId 29122 16:13:11.937330 tst mo_mt_call_osmux.py: using BVCI 29123 16:13:12.053607 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:12.065099 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:12.076379 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:12.087976 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:12.099493 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:12.110967 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:13:12.228796 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:13:12.343996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:12.802449 run create_hlr_db(pid=23117): Launched 16:13:12.916470 bus /sierra_2: Setting Powered False 16:13:13.976193 run create_hlr_db(pid=23117): Terminated: ok {rc=0} 16:13:14.388827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23119): Launched 16:13:14.684166 run osmo-hlr_10.42.42.2(pid=23120): Launched 16:13:14.797086 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:15.305270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23122): Launched 16:13:15.600858 run osmo-stp_10.42.42.5(pid=23123): Launched 16:13:15.713820 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:16.307981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23125): Launched 16:13:16.657660 run osmo-msc_10.42.42.6(pid=23126): Launched 16:13:16.868118 run osmo-stp_10.42.42.5(pid=23123): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23123)] 16:13:17.101331 run osmo-stp_10.42.42.5(pid=23123): stdout: | (launched: 2022-12-10_16:13:15.547115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:17.389692 run osmo-stp_10.42.42.5(pid=23123): stderr: | [0;m[38;5;43m20221210161315715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161315715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161315715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161315716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161315718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161315718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161315718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:17.527433 run osmo-stp_10.42.42.5(pid=23123): stdout: | (launched: 2022-12-10_16:13:15.547115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:17.654470 run osmo-stp_10.42.42.5(pid=23123): stderr: | [0;m[38;5;43m20221210161315715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161315715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161315715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161315716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161315718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161315718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161315718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:17.807112 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23123): Process ended prematurely: osmo-stp_10.42.42.5(pid=23123) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23123)] [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:13:17.816758 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:13:17.845181 run osmo-hlr_10.42.42.2(pid=23120): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23120)] 16:13:17.895815 run osmo-hlr_10.42.42.2(pid=23120): stdout: | (launched: 2022-12-10_16:13:14.630078) 16:13:17.948144 run osmo-hlr_10.42.42.2(pid=23120): stderr: | [0;m[1;31m20221210161314804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161314804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161314804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161314805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161314805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161314805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161314817 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161314825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161314826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161314826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:18.021479 run osmo-msc_10.42.42.6(pid=23126): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23126)] 16:13:18.072041 run osmo-msc_10.42.42.6(pid=23126): stdout: | (launched: 2022-12-10_16:13:16.588030) 16:13:18.124177 run osmo-msc_10.42.42.6(pid=23126): stderr: | [0;m[38;5;43m20221210161317258 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161317258 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7507f53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161317258 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161317258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161317259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161317259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161317261 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161317261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161317261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161317261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:18.176653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23119): Terminating (SIGTERM) 16:13:18.219075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23122): Terminating (SIGTERM) 16:13:18.261552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23125): Terminating (SIGTERM) 16:13:18.304435 --- ParallelTerminationStrategy: PID 23119 died... 16:13:18.324670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23119): Terminated: ok {rc=0} 16:13:18.371620 --- ParallelTerminationStrategy: PID 23122 died... 16:13:18.391326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23122): Terminated: ok {rc=0} 16:13:18.437571 --- ParallelTerminationStrategy: PID 23125 died... 16:13:18.457304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23125): Terminated: ok {rc=0} 16:13:18.545814 bus /sierra_3: Setting Powered False 16:13:19.644287 bus /sierra_3: Setting Powered False 16:13:20.759995 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:13:22.011844 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:13:22.019740 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:13:22.053113 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:13:22.079504 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:13:22.133288 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:13:22.166462 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:13:22.193281 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:13:22.740003 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:13:22.789180 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:22.800390 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:13:22.868558 tst mo_mt_call.py: using LAC 29123 16:13:22.984443 tst mo_mt_call.py: using RAC 53 16:13:23.101136 tst mo_mt_call.py: using CellId 29123 16:13:23.225666 tst mo_mt_call.py: using BVCI 29124 16:13:23.342601 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:23.354167 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:23.365445 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:23.376614 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:23.388005 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:23.399349 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:13:23.511706 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:13:23.623655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:24.081227 run create_hlr_db(pid=23131): Launched 16:13:24.194478 bus /sierra_2: Setting Powered False 16:13:25.253844 run create_hlr_db(pid=23131): Terminated: ok {rc=0} 16:13:25.689134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23133): Launched 16:13:26.005546 run osmo-hlr_10.42.42.2(pid=23134): Launched 16:13:26.126621 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:26.675150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23136): Launched 16:13:26.991302 run osmo-stp_10.42.42.5(pid=23137): Launched 16:13:27.111608 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:27.683481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23139): Launched 16:13:27.999653 run osmo-msc_10.42.42.6(pid=23140): Launched 16:13:28.176295 run osmo-stp_10.42.42.5(pid=23137): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23137)] 16:13:28.309883 run osmo-stp_10.42.42.5(pid=23137): stdout: | (launched: 2022-12-10_16:13:26.934342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:28.444629 run osmo-stp_10.42.42.5(pid=23137): stderr: | [0;m[38;5;43m20221210161327127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161327127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161327127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161327127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161327128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161327128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161327128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:28.578124 run osmo-stp_10.42.42.5(pid=23137): stdout: | (launched: 2022-12-10_16:13:26.934342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:28.705583 run osmo-stp_10.42.42.5(pid=23137): stderr: | [0;m[38;5;43m20221210161327127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161327127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161327127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161327127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161327128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161327128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161327128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:28.857755 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23137): Process ended prematurely: osmo-stp_10.42.42.5(pid=23137) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23137)] [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:13:28.867265 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:13:28.895580 run osmo-hlr_10.42.42.2(pid=23134): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23134)] 16:13:28.946434 run osmo-hlr_10.42.42.2(pid=23134): stdout: | (launched: 2022-12-10_16:13:25.948462) 16:13:28.998869 run osmo-hlr_10.42.42.2(pid=23134): stderr: | [0;m[1;31m20221210161326146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161326146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161326146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161326146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161326146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161326146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161326172 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161326184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161326184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161326184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:29.071698 run osmo-msc_10.42.42.6(pid=23140): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23140)] 16:13:29.122302 run osmo-msc_10.42.42.6(pid=23140): stdout: | (launched: 2022-12-10_16:13:27.942249) 16:13:29.174205 run osmo-msc_10.42.42.6(pid=23140): stderr: | [0;m[38;5;43m20221210161328262 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161328263 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc3c79d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161328263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161328263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161328263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161328263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161328265 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161328265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161328265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161328266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:29.226428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23133): Terminating (SIGTERM) 16:13:29.268211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23136): Terminating (SIGTERM) 16:13:29.310507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23139): Terminating (SIGTERM) 16:13:29.353241 --- ParallelTerminationStrategy: PID 23133 died... 16:13:29.373218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23133): Terminated: ok {rc=0} 16:13:29.420381 --- ParallelTerminationStrategy: PID 23136 died... 16:13:29.440367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23136): Terminated: ok {rc=0} 16:13:29.487340 --- ParallelTerminationStrategy: PID 23139 died... 16:13:29.507322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23139): Terminated: ok {rc=0} 16:13:29.595397 bus /sierra_3: Setting Powered False 16:13:30.695834 bus /sierra_3: Setting Powered False 16:13:31.813940 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:13:32.962814 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:32.975252 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:13:33.046822 tst mo_mt_call_osmux.py: using LAC 29124 16:13:33.172751 tst mo_mt_call_osmux.py: using RAC 54 16:13:33.298769 tst mo_mt_call_osmux.py: using CellId 29124 16:13:33.425262 tst mo_mt_call_osmux.py: using BVCI 29125 16:13:33.539861 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:33.551712 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:33.563334 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:33.575063 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:33.586834 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:33.598688 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:13:33.716878 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:13:33.839894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:34.330972 run create_hlr_db(pid=23142): Launched 16:13:34.459517 bus /sierra_2: Setting Powered False 16:13:35.518669 run create_hlr_db(pid=23142): Terminated: ok {rc=0} 16:13:35.960843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23144): Launched 16:13:36.277682 run osmo-hlr_10.42.42.2(pid=23145): Launched 16:13:36.397426 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:36.942336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23147): Launched 16:13:37.257557 run osmo-stp_10.42.42.5(pid=23148): Launched 16:13:37.377486 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:37.949842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23150): Launched 16:13:38.265278 run osmo-msc_10.42.42.6(pid=23151): Launched 16:13:38.440832 run osmo-stp_10.42.42.5(pid=23148): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23148)] 16:13:38.574058 run osmo-stp_10.42.42.5(pid=23148): stdout: | (launched: 2022-12-10_16:13:37.200369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:38.708422 run osmo-stp_10.42.42.5(pid=23148): stderr: | [0;m[38;5;43m20221210161337390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161337391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161337391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161337391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161337394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161337394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161337394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:38.842738 run osmo-stp_10.42.42.5(pid=23148): stdout: | (launched: 2022-12-10_16:13:37.200369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:38.969314 run osmo-stp_10.42.42.5(pid=23148): stderr: | [0;m[38;5;43m20221210161337390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161337391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161337391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161337391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161337394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161337394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161337394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:39.120794 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23148): Process ended prematurely: osmo-stp_10.42.42.5(pid=23148) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23148)] [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:13:39.130457 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:13:39.158263 run osmo-hlr_10.42.42.2(pid=23145): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23145)] 16:13:39.208096 run osmo-hlr_10.42.42.2(pid=23145): stdout: | (launched: 2022-12-10_16:13:36.220514) 16:13:39.259645 run osmo-hlr_10.42.42.2(pid=23145): stderr: | [0;m[1;31m20221210161336418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161336418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161336418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161336418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161336418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161336418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161336433 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161336443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161336443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161336443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:39.331558 run osmo-msc_10.42.42.6(pid=23151): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23151)] 16:13:39.381230 run osmo-msc_10.42.42.6(pid=23151): stdout: | (launched: 2022-12-10_16:13:38.207788) 16:13:39.432135 run osmo-msc_10.42.42.6(pid=23151): stderr: | [0;m[38;5;43m20221210161338528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161338528 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3637a19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161338529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161338529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161338529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161338529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161338531 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161338531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161338531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161338531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:39.483220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23144): Terminating (SIGTERM) 16:13:39.524351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23147): Terminating (SIGTERM) 16:13:39.565501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23150): Terminating (SIGTERM) 16:13:39.607302 --- ParallelTerminationStrategy: PID 23144 died... 16:13:39.627232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23144): Terminated: ok {rc=0} 16:13:39.673527 --- ParallelTerminationStrategy: PID 23147 died... 16:13:39.693334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23147): Terminated: ok {rc=0} 16:13:39.739640 --- ParallelTerminationStrategy: PID 23150 died... 16:13:39.759048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23150): Terminated: ok {rc=0} 16:13:39.845261 bus /sierra_3: Setting Powered False 16:13:40.944103 bus /sierra_3: Setting Powered False 16:13:42.058467 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:13:43.303494 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:13:43.309836 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:13:43.342673 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:13:43.369587 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:13:43.421541 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:13:43.454459 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:13:43.480999 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:13:44.029178 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:13:44.077656 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:44.088652 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:13:44.156266 tst mo_mt_call.py: using LAC 29125 16:13:44.273181 tst mo_mt_call.py: using RAC 55 16:13:44.398958 tst mo_mt_call.py: using CellId 29125 16:13:44.524605 tst mo_mt_call.py: using BVCI 29126 16:13:44.641969 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:44.653718 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:44.665223 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:44.676903 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:44.689065 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:44.700808 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:13:44.813361 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:13:44.927908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:45.385095 run create_hlr_db(pid=23156): Launched 16:13:45.497750 bus /sierra_2: Setting Powered False 16:13:46.572297 run create_hlr_db(pid=23156): Terminated: ok {rc=0} 16:13:47.050362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23158): Launched 16:13:47.361781 run osmo-hlr_10.42.42.2(pid=23159): Launched 16:13:47.474488 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:47.984505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23161): Launched 16:13:48.279921 run osmo-stp_10.42.42.5(pid=23162): Launched 16:13:48.392702 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:48.927873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23164): Launched 16:13:49.222709 run osmo-msc_10.42.42.6(pid=23165): Launched 16:13:49.387665 run osmo-stp_10.42.42.5(pid=23162): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23162)] 16:13:49.512826 run osmo-stp_10.42.42.5(pid=23162): stdout: | (launched: 2022-12-10_16:13:48.226135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:49.639260 run osmo-stp_10.42.42.5(pid=23162): stderr: | [0;m[38;5;43m20221210161348395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161348395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161348395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161348396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161348396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161348396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161348396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:49.763201 run osmo-stp_10.42.42.5(pid=23162): stdout: | (launched: 2022-12-10_16:13:48.226135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:49.881328 run osmo-stp_10.42.42.5(pid=23162): stderr: | [0;m[38;5;43m20221210161348395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161348395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161348395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161348396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161348396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161348396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161348396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:50.022410 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23162): Process ended prematurely: osmo-stp_10.42.42.5(pid=23162) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23162)] [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:13:50.031088 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:13:50.057979 run osmo-hlr_10.42.42.2(pid=23159): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23159)] 16:13:50.105778 run osmo-hlr_10.42.42.2(pid=23159): stdout: | (launched: 2022-12-10_16:13:47.308270) 16:13:50.155457 run osmo-hlr_10.42.42.2(pid=23159): stderr: | [0;m[1;31m20221210161347483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161347483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161347483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161347483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161347483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161347483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161347496 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161347506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161347506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161347506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:50.224564 run osmo-msc_10.42.42.6(pid=23165): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23165)] 16:13:50.272776 run osmo-msc_10.42.42.6(pid=23165): stdout: | (launched: 2022-12-10_16:13:49.168735) 16:13:50.322402 run osmo-msc_10.42.42.6(pid=23165): stderr: | [0;m[38;5;43m20221210161349440 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161349440 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc4fc14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161349440 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161349440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161349440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161349441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161349442 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161349443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161349443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161349443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:50.372169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23158): Terminating (SIGTERM) 16:13:50.411988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23161): Terminating (SIGTERM) 16:13:50.451946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23164): Terminating (SIGTERM) 16:13:50.492152 --- ParallelTerminationStrategy: PID 23158 died... 16:13:50.511533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23158): Terminated: ok {rc=0} 16:13:50.556350 --- ParallelTerminationStrategy: PID 23161 died... 16:13:50.575005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23161): Terminated: ok {rc=0} 16:13:50.619761 --- ParallelTerminationStrategy: PID 23164 died... 16:13:50.638784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23164): Terminated: ok {rc=0} 16:13:50.724630 bus /sierra_3: Setting Powered False 16:13:51.824372 bus /sierra_3: Setting Powered False 16:13:52.939253 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:13:54.085870 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:54.097619 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:13:54.166686 tst mo_mt_call_osmux.py: using LAC 29126 16:13:54.283943 tst mo_mt_call_osmux.py: using RAC 56 16:13:54.401455 tst mo_mt_call_osmux.py: using CellId 29126 16:13:54.519344 tst mo_mt_call_osmux.py: using BVCI 29127 16:13:54.627052 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:54.638204 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:54.649042 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:54.660039 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:54.671292 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:54.682304 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:13:54.795859 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:13:54.912009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:55.370453 run create_hlr_db(pid=23167): Launched 16:13:55.482660 bus /sierra_2: Setting Powered False 16:13:56.543012 run create_hlr_db(pid=23167): Terminated: ok {rc=0} 16:13:56.978010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23169): Launched 16:13:57.294433 run osmo-hlr_10.42.42.2(pid=23170): Launched 16:13:57.415306 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:57.959938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23172): Launched 16:13:58.276096 run osmo-stp_10.42.42.5(pid=23173): Launched 16:13:58.396810 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:58.970311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23175): Launched 16:13:59.285556 run osmo-msc_10.42.42.6(pid=23176): Launched 16:13:59.461547 run osmo-stp_10.42.42.5(pid=23173): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23173)] 16:13:59.594587 run osmo-stp_10.42.42.5(pid=23173): stdout: | (launched: 2022-12-10_16:13:58.218548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:59.729262 run osmo-stp_10.42.42.5(pid=23173): stderr: | [0;m[38;5;43m20221210161358408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161358409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161358409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161358409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161358410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161358410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161358410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:59.863244 run osmo-stp_10.42.42.5(pid=23173): stdout: | (launched: 2022-12-10_16:13:58.218548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:59.989634 run osmo-stp_10.42.42.5(pid=23173): stderr: | [0;m[38;5;43m20221210161358408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161358409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161358409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161358409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161358410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161358410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161358410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:00.140909 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23173): Process ended prematurely: osmo-stp_10.42.42.5(pid=23173) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23173)] [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:14:00.150502 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:14:00.178354 run osmo-hlr_10.42.42.2(pid=23170): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23170)] 16:14:00.228074 run osmo-hlr_10.42.42.2(pid=23170): stdout: | (launched: 2022-12-10_16:13:57.237141) 16:14:00.279841 run osmo-hlr_10.42.42.2(pid=23170): stderr: | [0;m[1;31m20221210161357433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161357433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161357433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161357433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161357433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161357433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161357446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161357454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161357454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161357454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:00.352073 run osmo-msc_10.42.42.6(pid=23176): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23176)] 16:14:00.401743 run osmo-msc_10.42.42.6(pid=23176): stdout: | (launched: 2022-12-10_16:13:59.228281) 16:14:00.453015 run osmo-msc_10.42.42.6(pid=23176): stderr: | [0;m[38;5;43m20221210161359550 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161359550 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0325e43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161359550 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161359550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161359550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161359550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161359552 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161359552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161359553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161359553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:00.504726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23169): Terminating (SIGTERM) 16:14:00.546186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23172): Terminating (SIGTERM) 16:14:00.587924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23175): Terminating (SIGTERM) 16:14:00.630152 --- ParallelTerminationStrategy: PID 23169 died... 16:14:00.650087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23169): Terminated: ok {rc=0} 16:14:00.696641 --- ParallelTerminationStrategy: PID 23172 died... 16:14:00.716290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23172): Terminated: ok {rc=0} 16:14:00.762373 --- ParallelTerminationStrategy: PID 23175 died... 16:14:00.781894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23175): Terminated: ok {rc=0} 16:14:00.893604 bus /sierra_3: Setting Powered False 16:14:01.987972 bus /sierra_3: Setting Powered False 16:14:03.102448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:14:04.359722 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:04.366803 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:14:04.400088 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:14:04.427468 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:14:04.481212 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:14:04.515147 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:14:04.541705 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:14:05.089379 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:14:05.137845 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:05.149193 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:14:05.216100 tst mo_mt_call.py: using LAC 29127 16:14:05.330888 tst mo_mt_call.py: using RAC 57 16:14:05.448508 tst mo_mt_call.py: using CellId 29127 16:14:05.564867 tst mo_mt_call.py: using BVCI 29128 16:14:05.672282 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:05.683504 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:05.694639 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:05.706171 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:05.717769 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:05.729132 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:14:05.845862 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:14:05.966276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:06.458282 run create_hlr_db(pid=23181): Launched 16:14:06.586703 bus /sierra_2: Setting Powered False 16:14:07.649681 run create_hlr_db(pid=23181): Terminated: ok {rc=0} 16:14:08.074645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23183): Launched 16:14:08.370250 run osmo-hlr_10.42.42.2(pid=23184): Launched 16:14:08.481982 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:09.004676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23186): Launched 16:14:09.300416 run osmo-stp_10.42.42.5(pid=23187): Launched 16:14:09.412441 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:09.948241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23189): Launched 16:14:10.244442 run osmo-msc_10.42.42.6(pid=23190): Launched 16:14:10.409389 run osmo-stp_10.42.42.5(pid=23187): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23187)] 16:14:10.534652 run osmo-stp_10.42.42.5(pid=23187): stdout: | (launched: 2022-12-10_16:14:09.246494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:10.659999 run osmo-stp_10.42.42.5(pid=23187): stderr: | [0;m[38;5;43m20221210161409417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161409417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161409417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161409418 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161409418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161409418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161409418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:10.783994 run osmo-stp_10.42.42.5(pid=23187): stdout: | (launched: 2022-12-10_16:14:09.246494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:10.902507 run osmo-stp_10.42.42.5(pid=23187): stderr: | [0;m[38;5;43m20221210161409417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161409417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161409417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161409418 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161409418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161409418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161409418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:11.044117 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23187): Process ended prematurely: osmo-stp_10.42.42.5(pid=23187) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23187)] [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:14:11.053009 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:14:11.079838 run osmo-hlr_10.42.42.2(pid=23184): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23184)] 16:14:11.128152 run osmo-hlr_10.42.42.2(pid=23184): stdout: | (launched: 2022-12-10_16:14:08.316540) 16:14:11.177936 run osmo-hlr_10.42.42.2(pid=23184): stderr: | [0;m[1;31m20221210161408493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161408493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161408493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161408493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161408493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161408494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161408506 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161408515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161408515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161408515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:11.247071 run osmo-msc_10.42.42.6(pid=23190): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23190)] 16:14:11.295117 run osmo-msc_10.42.42.6(pid=23190): stdout: | (launched: 2022-12-10_16:14:10.190487) 16:14:11.344781 run osmo-msc_10.42.42.6(pid=23190): stderr: | [0;m[38;5;43m20221210161410459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161410459 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb63faddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161410459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161410460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161410461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161410461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161410463 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161410463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161410463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161410463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:11.394936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23183): Terminating (SIGTERM) 16:14:11.434620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23186): Terminating (SIGTERM) 16:14:11.474534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23189): Terminating (SIGTERM) 16:14:11.514602 --- ParallelTerminationStrategy: PID 23183 died... 16:14:11.533722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23183): Terminated: ok {rc=0} 16:14:11.578451 --- ParallelTerminationStrategy: PID 23186 died... 16:14:11.597481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23186): Terminated: ok {rc=0} 16:14:11.641663 --- ParallelTerminationStrategy: PID 23189 died... 16:14:11.660414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23189): Terminated: ok {rc=0} 16:14:11.744165 bus /sierra_3: Setting Powered False 16:14:12.840629 bus /sierra_3: Setting Powered False 16:14:13.955370 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:14:15.104209 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:15.116433 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:14:15.186594 tst mo_mt_call_osmux.py: using LAC 29128 16:14:15.315810 tst mo_mt_call_osmux.py: using RAC 58 16:14:15.439942 tst mo_mt_call_osmux.py: using CellId 29128 16:14:15.564058 tst mo_mt_call_osmux.py: using BVCI 29129 16:14:15.678664 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:15.690288 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:15.702196 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:15.713684 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:15.725125 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:15.736436 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:14:15.868423 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:14:15.997052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:16.503677 run create_hlr_db(pid=23192): Launched 16:14:16.664723 bus /sierra_2: Setting Powered False 16:14:17.723166 run create_hlr_db(pid=23192): Terminated: ok {rc=0} 16:14:18.169946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23194): Launched 16:14:18.485669 run osmo-hlr_10.42.42.2(pid=23195): Launched 16:14:18.606176 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:19.156293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23197): Launched 16:14:19.472442 run osmo-stp_10.42.42.5(pid=23198): Launched 16:14:19.592296 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:20.161969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23200): Launched 16:14:20.476621 run osmo-msc_10.42.42.6(pid=23201): Launched 16:14:20.651963 run osmo-stp_10.42.42.5(pid=23198): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23198)] 16:14:20.786003 run osmo-stp_10.42.42.5(pid=23198): stdout: | (launched: 2022-12-10_16:14:19.415178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:20.919344 run osmo-stp_10.42.42.5(pid=23198): stderr: | [0;m[38;5;43m20221210161419605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161419606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161419606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161419606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161419607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161419607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161419607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:21.052920 run osmo-stp_10.42.42.5(pid=23198): stdout: | (launched: 2022-12-10_16:14:19.415178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:21.179139 run osmo-stp_10.42.42.5(pid=23198): stderr: | [0;m[38;5;43m20221210161419605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161419606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161419606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161419606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161419607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161419607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161419607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:21.329796 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23198): Process ended prematurely: osmo-stp_10.42.42.5(pid=23198) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23198)] [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:14:21.339361 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:14:21.367405 run osmo-hlr_10.42.42.2(pid=23195): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23195)] 16:14:21.417408 run osmo-hlr_10.42.42.2(pid=23195): stdout: | (launched: 2022-12-10_16:14:18.428304) 16:14:21.468879 run osmo-hlr_10.42.42.2(pid=23195): stderr: | [0;m[1;31m20221210161418627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161418627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161418627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161418627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161418627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161418627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161418641 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161418649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161418649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161418649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:21.540839 run osmo-msc_10.42.42.6(pid=23201): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23201)] 16:14:21.590793 run osmo-msc_10.42.42.6(pid=23201): stdout: | (launched: 2022-12-10_16:14:20.419331) 16:14:21.641869 run osmo-msc_10.42.42.6(pid=23201): stderr: | [0;m[38;5;43m20221210161420741 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161420741 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd94d44ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161420741 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161420741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161420741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161420742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161420743 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161420744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161420744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161420744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:21.693408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23194): Terminating (SIGTERM) 16:14:21.735144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23197): Terminating (SIGTERM) 16:14:21.776761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23200): Terminating (SIGTERM) 16:14:21.818870 --- ParallelTerminationStrategy: PID 23194 died... 16:14:21.838707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23194): Terminated: ok {rc=0} 16:14:21.885132 --- ParallelTerminationStrategy: PID 23197 died... 16:14:21.904553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23197): Terminated: ok {rc=0} 16:14:21.950470 --- ParallelTerminationStrategy: PID 23200 died... 16:14:21.969949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23200): Terminated: ok {rc=0} 16:14:22.056497 bus /sierra_3: Setting Powered False 16:14:23.154700 bus /sierra_3: Setting Powered False 16:14:24.270638 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:14:25.516563 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:25.523017 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:14:25.555844 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:14:25.582577 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:14:25.635013 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:14:25.667638 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:14:25.694054 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:14:26.242476 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:14:26.290895 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:26.302122 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:14:26.369352 tst mo_mt_call.py: using LAC 29129 16:14:26.490964 tst mo_mt_call.py: using RAC 59 16:14:26.606664 tst mo_mt_call.py: using CellId 29129 16:14:26.723405 tst mo_mt_call.py: using BVCI 29130 16:14:26.840240 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:26.851973 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:26.863528 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:26.875172 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:26.886954 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:26.898565 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:14:27.013352 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:14:27.126256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:27.582269 run create_hlr_db(pid=23206): Launched 16:14:27.695613 bus /sierra_2: Setting Powered False 16:14:28.758984 run create_hlr_db(pid=23206): Terminated: ok {rc=0} 16:14:29.200413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23208): Launched 16:14:29.516367 run osmo-hlr_10.42.42.2(pid=23209): Launched 16:14:29.637357 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:30.180424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23211): Launched 16:14:30.495167 run osmo-stp_10.42.42.5(pid=23212): Launched 16:14:30.615878 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:31.206936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23214): Launched 16:14:31.534425 run osmo-msc_10.42.42.6(pid=23215): Launched 16:14:31.758305 run osmo-stp_10.42.42.5(pid=23212): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23212)] 16:14:32.104177 run osmo-stp_10.42.42.5(pid=23212): stdout: | (launched: 2022-12-10_16:14:30.438177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:32.246755 run osmo-stp_10.42.42.5(pid=23212): stderr: | [0;m[38;5;43m20221210161430626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161430627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161430627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161430627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161430629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161430630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161430630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:32.380031 run osmo-stp_10.42.42.5(pid=23212): stdout: | (launched: 2022-12-10_16:14:30.438177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:32.506692 run osmo-stp_10.42.42.5(pid=23212): stderr: | [0;m[38;5;43m20221210161430626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161430627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161430627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161430627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161430629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161430630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161430630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:32.658124 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23212): Process ended prematurely: osmo-stp_10.42.42.5(pid=23212) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23212)] [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:14:32.667775 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:14:32.695738 run osmo-hlr_10.42.42.2(pid=23209): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23209)] 16:14:32.746371 run osmo-hlr_10.42.42.2(pid=23209): stdout: | (launched: 2022-12-10_16:14:29.459097) 16:14:32.798491 run osmo-hlr_10.42.42.2(pid=23209): stderr: | [0;m[1;31m20221210161429658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161429658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161429658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161429658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161429658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161429658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161429672 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161429682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161429682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161429682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:32.870926 run osmo-msc_10.42.42.6(pid=23215): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23215)] 16:14:32.921113 run osmo-msc_10.42.42.6(pid=23215): stdout: | (launched: 2022-12-10_16:14:31.474953) 16:14:32.972749 run osmo-msc_10.42.42.6(pid=23215): stderr: | [0;m[38;5;43m20221210161431968 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161431968 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffb86171c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161431968 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161431968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161431969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161431969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161431971 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161431971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161431971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161431971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:33.025447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23208): Terminating (SIGTERM) 16:14:33.067451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23211): Terminating (SIGTERM) 16:14:33.109491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23214): Terminating (SIGTERM) 16:14:33.151620 --- ParallelTerminationStrategy: PID 23208 died... 16:14:33.171658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23208): Terminated: ok {rc=0} 16:14:33.218649 --- ParallelTerminationStrategy: PID 23211 died... 16:14:33.238462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23211): Terminated: ok {rc=0} 16:14:33.284632 --- ParallelTerminationStrategy: PID 23214 died... 16:14:33.304257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23214): Terminated: ok {rc=0} 16:14:33.391421 bus /sierra_3: Setting Powered False 16:14:34.489915 bus /sierra_3: Setting Powered False 16:14:35.604196 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:14:36.751993 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:36.764066 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:14:36.835206 tst mo_mt_call_osmux.py: using LAC 29130 16:14:36.960302 tst mo_mt_call_osmux.py: using RAC 60 16:14:37.084636 tst mo_mt_call_osmux.py: using CellId 29130 16:14:37.204737 tst mo_mt_call_osmux.py: using BVCI 29131 16:14:37.311982 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:37.323329 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:37.334505 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:37.345995 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:37.357552 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:37.368900 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:14:37.486211 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:14:37.601867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:38.060093 run create_hlr_db(pid=23217): Launched 16:14:38.173940 bus /sierra_2: Setting Powered False 16:14:39.233194 run create_hlr_db(pid=23217): Terminated: ok {rc=0} 16:14:39.647600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23219): Launched 16:14:39.942975 run osmo-hlr_10.42.42.2(pid=23220): Launched 16:14:40.055721 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:40.564865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23222): Launched 16:14:40.860352 run osmo-stp_10.42.42.5(pid=23223): Launched 16:14:40.973611 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:41.507653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23225): Launched 16:14:41.802677 run osmo-msc_10.42.42.6(pid=23226): Launched 16:14:41.967436 run osmo-stp_10.42.42.5(pid=23223): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23223)] 16:14:42.091907 run osmo-stp_10.42.42.5(pid=23223): stdout: | (launched: 2022-12-10_16:14:40.806223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:42.216783 run osmo-stp_10.42.42.5(pid=23223): stderr: | [0;m[38;5;43m20221210161440976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161440976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161440976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161440977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161440977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161440977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161440977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:42.340397 run osmo-stp_10.42.42.5(pid=23223): stdout: | (launched: 2022-12-10_16:14:40.806223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:42.458344 run osmo-stp_10.42.42.5(pid=23223): stderr: | [0;m[38;5;43m20221210161440976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161440976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161440976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161440977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161440977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161440977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161440977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:42.599476 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23223): Process ended prematurely: osmo-stp_10.42.42.5(pid=23223) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23223)] [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:14:42.608333 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 16:14:42.635109 run osmo-hlr_10.42.42.2(pid=23220): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23220)] 16:14:42.682645 run osmo-hlr_10.42.42.2(pid=23220): stdout: | (launched: 2022-12-10_16:14:39.889398) 16:14:42.732141 run osmo-hlr_10.42.42.2(pid=23220): stderr: | [0;m[1;31m20221210161440066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161440067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161440067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161440067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161440067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161440067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161440079 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161440089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161440089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161440089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:42.800738 run osmo-msc_10.42.42.6(pid=23226): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23226)] 16:14:42.848025 run osmo-msc_10.42.42.6(pid=23226): stdout: | (launched: 2022-12-10_16:14:41.748890) 16:14:42.896808 run osmo-msc_10.42.42.6(pid=23226): stderr: | [0;m[38;5;43m20221210161442022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161442023 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2abe64dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161442023 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161442023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161442023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161442023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161442025 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161442025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161442025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161442026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:42.946523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23219): Terminating (SIGTERM) 16:14:42.986067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23222): Terminating (SIGTERM) 16:14:43.025627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23225): Terminating (SIGTERM) 16:14:43.065749 --- ParallelTerminationStrategy: PID 23219 died... 16:14:43.084694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23219): Terminated: ok {rc=0} 16:14:43.129133 --- ParallelTerminationStrategy: PID 23222 died... 16:14:43.147645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23222): Terminated: ok {rc=0} 16:14:43.191757 --- ParallelTerminationStrategy: PID 23225 died... 16:14:43.210319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23225): Terminated: ok {rc=0} 16:14:43.295779 bus /sierra_3: Setting Powered False 16:14:44.395524 bus /sierra_3: Setting Powered False 16:14:45.508487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:14:46.761660 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:46.772079 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:14:46.807402 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:14:46.835871 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:14:46.888722 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:14:46.944010 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:14:46.987089 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:14:47.498438 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:14:47.547992 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:47.559250 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:14:47.627822 tst mo_mt_call.py: using LAC 29131 16:14:47.744827 tst mo_mt_call.py: using RAC 61 16:14:47.870192 tst mo_mt_call.py: using CellId 29131 16:14:47.993859 tst mo_mt_call.py: using BVCI 29132 16:14:48.110081 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:48.121860 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:48.133568 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:48.145322 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:48.157160 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:48.168825 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:14:48.283707 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:14:48.400681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:48.859082 run create_hlr_db(pid=23232): Launched 16:14:48.972254 bus /sierra_2: Setting Powered False 16:14:50.032359 run create_hlr_db(pid=23232): Terminated: ok {rc=0} 16:14:50.464866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23234): Launched 16:14:50.781626 run osmo-hlr_10.42.42.2(pid=23235): Launched 16:14:50.902009 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:51.447223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23237): Launched 16:14:51.762647 run osmo-stp_10.42.42.5(pid=23238): Launched 16:14:51.882847 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:52.453024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23240): Launched 16:14:52.769524 run osmo-msc_10.42.42.6(pid=23241): Launched 16:14:52.946111 run osmo-stp_10.42.42.5(pid=23238): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23238)] 16:14:53.079506 run osmo-stp_10.42.42.5(pid=23238): stdout: | (launched: 2022-12-10_16:14:51.704894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:53.213962 run osmo-stp_10.42.42.5(pid=23238): stderr: | [0;m[38;5;43m20221210161451896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161451896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161451896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161451897 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161451899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161451899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161451899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:53.347806 run osmo-stp_10.42.42.5(pid=23238): stdout: | (launched: 2022-12-10_16:14:51.704894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:53.474591 run osmo-stp_10.42.42.5(pid=23238): stderr: | [0;m[38;5;43m20221210161451896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161451896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161451896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161451897 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161451899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161451899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161451899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:53.626616 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23238): Process ended prematurely: osmo-stp_10.42.42.5(pid=23238) [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23238)] [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:14:53.636096 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:14:53.664303 run osmo-hlr_10.42.42.2(pid=23235): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23235)] 16:14:53.714422 run osmo-hlr_10.42.42.2(pid=23235): stdout: | (launched: 2022-12-10_16:14:50.724141) 16:14:53.766617 run osmo-hlr_10.42.42.2(pid=23235): stderr: | [0;m[1;31m20221210161450921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161450921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161450921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161450921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161450921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161450921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161450933 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161450941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161450942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161450942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:53.838735 run osmo-msc_10.42.42.6(pid=23241): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23241)] 16:14:53.888676 run osmo-msc_10.42.42.6(pid=23241): stdout: | (launched: 2022-12-10_16:14:52.711685) 16:14:53.940101 run osmo-msc_10.42.42.6(pid=23241): stderr: | [0;m[38;5;43m20221210161453031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161453031 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3aea5b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161453032 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161453032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161453032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161453032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161453034 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161453034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161453034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161453034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:53.991844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23234): Terminating (SIGTERM) 16:14:54.033503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23237): Terminating (SIGTERM) 16:14:54.075279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23240): Terminating (SIGTERM) 16:14:54.117401 --- ParallelTerminationStrategy: PID 23234 died... 16:14:54.137223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23234): Terminated: ok {rc=0} 16:14:54.183587 --- ParallelTerminationStrategy: PID 23237 died... 16:14:54.203200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23237): Terminated: ok {rc=0} 16:14:54.249692 --- ParallelTerminationStrategy: PID 23240 died... 16:14:54.269407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23240): Terminated: ok {rc=0} 16:14:54.356369 bus /sierra_3: Setting Powered False 16:14:55.455481 bus /sierra_3: Setting Powered False 16:14:56.570553 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:14:57.718130 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:57.730876 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:14:57.803629 tst mo_mt_call_osmux.py: using LAC 29132 16:14:57.929505 tst mo_mt_call_osmux.py: using RAC 62 16:14:58.054182 tst mo_mt_call_osmux.py: using CellId 29132 16:14:58.176268 tst mo_mt_call_osmux.py: using BVCI 29133 16:14:58.292931 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:58.304646 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:58.316173 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:58.328207 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:58.340273 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:58.352325 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:14:58.471102 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:14:58.585968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:59.044643 run create_hlr_db(pid=23243): Launched 16:14:59.159223 bus /sierra_2: Setting Powered False 16:15:00.218701 run create_hlr_db(pid=23243): Terminated: ok {rc=0} 16:15:00.635172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23245): Launched 16:15:00.945782 run osmo-hlr_10.42.42.2(pid=23246): Launched 16:15:01.251605 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:01.810684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23251): Launched 16:15:02.197744 run osmo-stp_10.42.42.5(pid=23252): Launched 16:15:02.396350 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:02.963280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23254): Launched 16:15:03.259586 run osmo-msc_10.42.42.6(pid=23255): Launched 16:15:03.425263 run osmo-stp_10.42.42.5(pid=23252): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23252)] 16:15:03.550987 run osmo-stp_10.42.42.5(pid=23252): stdout: | (launched: 2022-12-10_16:15:02.128778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:03.677291 run osmo-stp_10.42.42.5(pid=23252): stderr: | [0;m[38;5;43m20221210161502411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161502411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161502411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161502412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161502412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161502412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161502412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:03.801224 run osmo-stp_10.42.42.5(pid=23252): stdout: | (launched: 2022-12-10_16:15:02.128778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:03.919889 run osmo-stp_10.42.42.5(pid=23252): stderr: | [0;m[38;5;43m20221210161502411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161502411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161502411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161502412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161502412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161502412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161502412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:04.061796 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23252): Process ended prematurely: osmo-stp_10.42.42.5(pid=23252) [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23252)] [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:15:04.070703 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:15:04.097351 run osmo-hlr_10.42.42.2(pid=23246): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23246)] 16:15:04.145434 run osmo-hlr_10.42.42.2(pid=23246): stdout: | (launched: 2022-12-10_16:15:00.877705) 16:15:04.194865 run osmo-hlr_10.42.42.2(pid=23246): stderr: | [0;m[1;31m20221210161501096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161501096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161501096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161501096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161501096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161501096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161501115 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161501132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161501134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161501134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:04.263718 run osmo-msc_10.42.42.6(pid=23255): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23255)] 16:15:04.311738 run osmo-msc_10.42.42.6(pid=23255): stdout: | (launched: 2022-12-10_16:15:03.205638) 16:15:04.360937 run osmo-msc_10.42.42.6(pid=23255): stderr: | [0;m[38;5;43m20221210161503475 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161503475 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2cfc443c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161503475 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161503476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161503476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161503476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161503478 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161503478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161503478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161503478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:04.410583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23245): Terminating (SIGTERM) 16:15:04.450519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23251): Terminating (SIGTERM) 16:15:04.490290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23254): Terminating (SIGTERM) 16:15:04.530560 --- ParallelTerminationStrategy: PID 23245 died... 16:15:04.549647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23245): Terminated: ok {rc=0} 16:15:04.594456 --- ParallelTerminationStrategy: PID 23251 died... 16:15:04.613141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23251): Terminated: ok {rc=0} 16:15:04.658082 --- ParallelTerminationStrategy: PID 23254 died... 16:15:04.676799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23254): Terminated: ok {rc=0} 16:15:04.763375 bus /sierra_3: Setting Powered False 16:15:05.861328 bus /sierra_3: Setting Powered False 16:15:06.974393 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:15:08.223450 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:15:08.229121 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:15:08.262309 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:15:08.288865 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:15:08.342419 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:15:08.376084 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:15:08.402780 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:15:08.949527 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:15:08.997961 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:09.009069 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:15:09.077986 tst mo_mt_call.py: using LAC 29133 16:15:09.196652 tst mo_mt_call.py: using RAC 63 16:15:09.312440 tst mo_mt_call.py: using CellId 29133 16:15:09.428545 tst mo_mt_call.py: using BVCI 29134 16:15:09.536931 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:09.547750 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:09.558390 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:09.569603 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:09.580736 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:09.592014 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:15:09.709368 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:15:09.824210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:10.282368 run create_hlr_db(pid=23260): Launched 16:15:10.394367 bus /sierra_2: Setting Powered False 16:15:11.453758 run create_hlr_db(pid=23260): Terminated: ok {rc=0} 16:15:11.868004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23262): Launched 16:15:12.164459 run osmo-hlr_10.42.42.2(pid=23263): Launched 16:15:12.277448 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:12.784610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23265): Launched 16:15:13.079650 run osmo-stp_10.42.42.5(pid=23266): Launched 16:15:13.192763 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:13.727127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23268): Launched 16:15:14.022626 run osmo-msc_10.42.42.6(pid=23269): Launched 16:15:14.187210 run osmo-stp_10.42.42.5(pid=23266): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23266)] 16:15:14.312369 run osmo-stp_10.42.42.5(pid=23266): stdout: | (launched: 2022-12-10_16:15:13.025695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:14.438034 run osmo-stp_10.42.42.5(pid=23266): stderr: | [0;m[38;5;43m20221210161513194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161513194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161513195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161513195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161513195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161513196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161513196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:14.561600 run osmo-stp_10.42.42.5(pid=23266): stdout: | (launched: 2022-12-10_16:15:13.025695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:14.679786 run osmo-stp_10.42.42.5(pid=23266): stderr: | [0;m[38;5;43m20221210161513194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161513194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161513195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161513195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161513195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161513196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161513196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:14.821518 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23266): Process ended prematurely: osmo-stp_10.42.42.5(pid=23266) [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23266)] [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:15:14.830419 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 16:15:14.857333 run osmo-hlr_10.42.42.2(pid=23263): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23263)] 16:15:14.905489 run osmo-hlr_10.42.42.2(pid=23263): stdout: | (launched: 2022-12-10_16:15:12.110312) 16:15:14.955042 run osmo-hlr_10.42.42.2(pid=23263): stderr: | [0;m[1;31m20221210161512284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161512284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161512284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161512284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161512284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161512284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161512296 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161512304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161512304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161512305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:15.024028 run osmo-msc_10.42.42.6(pid=23269): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23269)] 16:15:15.071945 run osmo-msc_10.42.42.6(pid=23269): stdout: | (launched: 2022-12-10_16:15:13.967816) 16:15:15.121333 run osmo-msc_10.42.42.6(pid=23269): stderr: | [0;m[38;5;43m20221210161514237 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161514238 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f49fc565c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161514238 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161514238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161514238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161514238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161514240 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161514240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161514240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161514241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:15.171209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23262): Terminating (SIGTERM) 16:15:15.211215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23265): Terminating (SIGTERM) 16:15:15.251053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23268): Terminating (SIGTERM) 16:15:15.291399 --- ParallelTerminationStrategy: PID 23262 died... 16:15:15.310454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23262): Terminated: ok {rc=0} 16:15:15.354939 --- ParallelTerminationStrategy: PID 23265 died... 16:15:15.373668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23265): Terminated: ok {rc=0} 16:15:15.418176 --- ParallelTerminationStrategy: PID 23268 died... 16:15:15.436909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23268): Terminated: ok {rc=0} 16:15:15.522872 bus /sierra_3: Setting Powered False 16:15:16.623773 bus /sierra_3: Setting Powered False 16:15:17.739477 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:15:18.887247 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:18.899446 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:15:18.970714 tst mo_mt_call_osmux.py: using LAC 29134 16:15:19.095604 tst mo_mt_call_osmux.py: using RAC 64 16:15:19.219577 tst mo_mt_call_osmux.py: using CellId 29134 16:15:19.349340 tst mo_mt_call_osmux.py: using BVCI 29135 16:15:19.465068 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:19.476532 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:19.487712 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:19.499010 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:19.510283 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:19.521723 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:15:19.635067 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:15:19.752360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:20.244795 run create_hlr_db(pid=23271): Launched 16:15:20.373854 bus /sierra_2: Setting Powered False 16:15:21.437563 run create_hlr_db(pid=23271): Terminated: ok {rc=0} 16:15:21.863294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23273): Launched 16:15:22.159521 run osmo-hlr_10.42.42.2(pid=23274): Launched 16:15:22.271618 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:22.795052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23276): Launched 16:15:23.090540 run osmo-stp_10.42.42.5(pid=23277): Launched 16:15:23.202735 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:23.743392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23279): Launched 16:15:24.040115 run osmo-msc_10.42.42.6(pid=23280): Launched 16:15:24.207329 run osmo-stp_10.42.42.5(pid=23277): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23277)] 16:15:24.333558 run osmo-stp_10.42.42.5(pid=23277): stdout: | (launched: 2022-12-10_16:15:23.036269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:24.460174 run osmo-stp_10.42.42.5(pid=23277): stderr: | [0;m[38;5;43m20221210161523204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161523205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161523205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161523205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161523206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161523206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161523206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:24.583924 run osmo-stp_10.42.42.5(pid=23277): stdout: | (launched: 2022-12-10_16:15:23.036269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:24.702455 run osmo-stp_10.42.42.5(pid=23277): stderr: | [0;m[38;5;43m20221210161523204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161523205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161523205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161523205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161523206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161523206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161523206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:24.844445 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23277): Process ended prematurely: osmo-stp_10.42.42.5(pid=23277) [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23277)] [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:15:24.853311 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:15:24.880149 run osmo-hlr_10.42.42.2(pid=23274): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23274)] 16:15:24.928535 run osmo-hlr_10.42.42.2(pid=23274): stdout: | (launched: 2022-12-10_16:15:22.105411) 16:15:24.978334 run osmo-hlr_10.42.42.2(pid=23274): stderr: | [0;m[1;31m20221210161522282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161522282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161522282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161522282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161522282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161522282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161522295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161522303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161522303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161522303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:25.048020 run osmo-msc_10.42.42.6(pid=23280): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23280)] 16:15:25.096101 run osmo-msc_10.42.42.6(pid=23280): stdout: | (launched: 2022-12-10_16:15:23.985718) 16:15:25.145808 run osmo-msc_10.42.42.6(pid=23280): stderr: | [0;m[38;5;43m20221210161524259 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161524260 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a70c84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161524260 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161524260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161524260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161524260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161524262 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161524262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161524263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161524263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:25.196018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23273): Terminating (SIGTERM) 16:15:25.236104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23276): Terminating (SIGTERM) 16:15:25.276465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23279): Terminating (SIGTERM) 16:15:25.316940 --- ParallelTerminationStrategy: PID 23273 died... 16:15:25.336125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23273): Terminated: ok {rc=0} 16:15:25.380746 --- ParallelTerminationStrategy: PID 23276 died... 16:15:25.399378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23276): Terminated: ok {rc=0} 16:15:25.443737 --- ParallelTerminationStrategy: PID 23279 died... 16:15:25.462320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23279): Terminated: ok {rc=0} 16:15:25.549411 bus /sierra_3: Setting Powered False 16:15:26.648897 bus /sierra_3: Setting Powered False 16:15:27.765314 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:15:29.010130 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:15:29.017864 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:15:29.051014 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 16:15:29.078549 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 16:15:29.130771 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:15:29.163717 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 16:15:29.190736 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 16:15:29.743923 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 16:15:29.794704 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:29.806579 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:15:29.859557 tst mo_mt_call.py: using LAC 29135 16:15:29.985783 tst mo_mt_call.py: using RAC 65 16:15:30.111695 tst mo_mt_call.py: using CellId 29135 16:15:30.236496 tst mo_mt_call.py: using BVCI 29136 16:15:30.352051 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:30.363782 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:30.375278 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:30.386736 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:30.398286 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:30.409820 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:15:30.522498 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:15:30.635610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:31.139988 run create_hlr_db(pid=23288): Launched 16:15:31.290192 bus /sierra_2: Setting Powered False 16:15:32.349441 run create_hlr_db(pid=23288): Terminated: ok {rc=0} 16:15:32.775532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23290): Launched 16:15:33.070514 run osmo-hlr_10.42.42.2(pid=23291): Launched 16:15:33.182097 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:33.689306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23293): Launched 16:15:33.985270 run osmo-stp_10.42.42.5(pid=23294): Launched 16:15:34.097874 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:34.635100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23296): Launched 16:15:34.931375 run osmo-msc_10.42.42.6(pid=23297): Launched 16:15:35.096505 run osmo-stp_10.42.42.5(pid=23294): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23294)] 16:15:35.222789 run osmo-stp_10.42.42.5(pid=23294): stdout: | (launched: 2022-12-10_16:15:33.931032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:35.349376 run osmo-stp_10.42.42.5(pid=23294): stderr: | [0;m[38;5;43m20221210161534101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161534101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161534101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161534102 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161534102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161534102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161534102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:35.473465 run osmo-stp_10.42.42.5(pid=23294): stdout: | (launched: 2022-12-10_16:15:33.931032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:35.591755 run osmo-stp_10.42.42.5(pid=23294): stderr: | [0;m[38;5;43m20221210161534101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161534101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161534101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161534102 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161534102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161534102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161534102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:35.733554 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23294): Process ended prematurely: osmo-stp_10.42.42.5(pid=23294) [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23294)] [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 16:15:35.742584 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:15:35.769147 run osmo-hlr_10.42.42.2(pid=23291): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23291)] 16:15:35.817773 run osmo-hlr_10.42.42.2(pid=23291): stdout: | (launched: 2022-12-10_16:15:33.016743) 16:15:35.867717 run osmo-hlr_10.42.42.2(pid=23291): stderr: | [0;m[1;31m20221210161533191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161533191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161533191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161533191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161533191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161533191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161533203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161533212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161533212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161533212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:35.937314 run osmo-msc_10.42.42.6(pid=23297): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23297)] 16:15:35.985404 run osmo-msc_10.42.42.6(pid=23297): stdout: | (launched: 2022-12-10_16:15:34.877357) 16:15:36.034934 run osmo-msc_10.42.42.6(pid=23297): stderr: | [0;m[38;5;43m20221210161535150 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161535150 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa65de3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161535150 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161535150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161535150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161535150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161535152 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161535152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161535153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161535153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:36.085120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23290): Terminating (SIGTERM) 16:15:36.125481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23293): Terminating (SIGTERM) 16:15:36.165863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23296): Terminating (SIGTERM) 16:15:36.206677 --- ParallelTerminationStrategy: PID 23290 died... 16:15:36.225911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23290): Terminated: ok {rc=0} 16:15:36.271099 --- ParallelTerminationStrategy: PID 23293 died... 16:15:36.289785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23293): Terminated: ok {rc=0} 16:15:36.334277 --- ParallelTerminationStrategy: PID 23296 died... 16:15:36.353160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23296): Terminated: ok {rc=0} 16:15:36.439565 bus /sierra_3: Setting Powered False 16:15:37.539714 bus /sierra_3: Setting Powered False 16:15:38.655946 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 16:15:39.804352 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:39.816567 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:15:39.868329 tst mo_mt_call_osmux.py: using LAC 29136 16:15:39.990884 tst mo_mt_call_osmux.py: using RAC 66 16:15:40.115619 tst mo_mt_call_osmux.py: using CellId 29136 16:15:40.239365 tst mo_mt_call_osmux.py: using BVCI 29137 16:15:40.356059 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:40.367915 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:40.379434 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:40.391068 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:40.402770 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:40.414738 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:15:40.531377 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:15:40.648917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:41.140158 run create_hlr_db(pid=23299): Launched 16:15:41.268030 bus /sierra_2: Setting Powered False 16:15:42.331472 run create_hlr_db(pid=23299): Terminated: ok {rc=0} 16:15:42.755693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23301): Launched 16:15:43.051462 run osmo-hlr_10.42.42.2(pid=23302): Launched 16:15:43.163705 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:43.674471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23304): Launched 16:15:43.970280 run osmo-stp_10.42.42.5(pid=23305): Launched 16:15:44.082546 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:44.617141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23307): Launched 16:15:44.912874 run osmo-msc_10.42.42.6(pid=23308): Launched 16:15:45.078564 run osmo-stp_10.42.42.5(pid=23305): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23305)] 16:15:45.204806 run osmo-stp_10.42.42.5(pid=23305): stdout: | (launched: 2022-12-10_16:15:43.916404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:45.331343 run osmo-stp_10.42.42.5(pid=23305): stderr: | [0;m[38;5;43m20221210161544087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161544087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161544087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161544088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161544088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161544088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161544089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:45.455425 run osmo-stp_10.42.42.5(pid=23305): stdout: | (launched: 2022-12-10_16:15:43.916404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:45.574271 run osmo-stp_10.42.42.5(pid=23305): stderr: | [0;m[38;5;43m20221210161544087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161544087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161544087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161544088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161544088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161544088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161544089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:45.716227 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23305): Process ended prematurely: osmo-stp_10.42.42.5(pid=23305) [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23305)] [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 16:15:45.725236 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:15:45.752011 run osmo-hlr_10.42.42.2(pid=23302): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23302)] 16:15:45.800125 run osmo-hlr_10.42.42.2(pid=23302): stdout: | (launched: 2022-12-10_16:15:42.997434) 16:15:45.850596 run osmo-hlr_10.42.42.2(pid=23302): stderr: | [0;m[1;31m20221210161543170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161543170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161543171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161543171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161543171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161543171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161543186 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161543196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161543196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161543196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:45.932358 run osmo-msc_10.42.42.6(pid=23308): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23308)] 16:15:45.981743 run osmo-msc_10.42.42.6(pid=23308): stdout: | (launched: 2022-12-10_16:15:44.858795) 16:15:46.033719 run osmo-msc_10.42.42.6(pid=23308): stderr: | [0;m[38;5;43m20221210161545130 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161545130 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f09d0e31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161545130 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161545130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161545131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161545131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161545132 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161545133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161545133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161545133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:46.085839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23301): Terminating (SIGTERM) 16:15:46.127692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23304): Terminating (SIGTERM) 16:15:46.169619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23307): Terminating (SIGTERM) 16:15:46.211750 --- ParallelTerminationStrategy: PID 23301 died... 16:15:46.231341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23301): Terminated: ok {rc=0} 16:15:46.278619 --- ParallelTerminationStrategy: PID 23304 died... 16:15:46.298207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23304): Terminated: ok {rc=0} 16:15:46.345410 --- ParallelTerminationStrategy: PID 23307 died... 16:15:46.364834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23307): Terminated: ok {rc=0} 16:15:46.453334 bus /sierra_3: Setting Powered False 16:15:47.549777 bus /sierra_3: Setting Powered False 16:15:48.662911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 emergency:trx-umtrx --------------------------------------------------------------------- 16:15:49.910603 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:15:49.915000 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:15:49.947658 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:15:49.974142 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 16:15:50.057466 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:15:50.089670 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:15:50.116148 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 16:15:50.701743 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2376 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 16:15:50.708099 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:50.719801 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 16:15:50.776410 tst emergency_mo_mt_call.py: using LAC 29137 16:15:50.899173 tst emergency_mo_mt_call.py: using RAC 67 16:15:51.020746 tst emergency_mo_mt_call.py: using CellId 29137 16:15:51.141373 tst emergency_mo_mt_call.py: using BVCI 29138 16:15:51.253728 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:51.264680 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:51.275557 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:51.286485 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:51.297350 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:51.308210 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:15:51.420625 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:15:51.539305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:52.022312 run create_hlr_db(pid=23313): Launched 16:15:52.148845 bus /sierra_2: Setting Powered False 16:15:53.211468 run create_hlr_db(pid=23313): Terminated: ok {rc=0} 16:15:53.646278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23315): Launched 16:15:53.957576 run osmo-hlr_10.42.42.2(pid=23316): Launched 16:15:54.076656 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:54.618756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23318): Launched 16:15:54.931861 run osmo-stp_10.42.42.5(pid=23319): Launched 16:15:55.060310 tst emergency_mo_mt_call.py: using MSISDN 7790 16:15:55.221255 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:55.784913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23321): Launched 16:15:56.098182 run osmo-msc_10.42.42.6(pid=23322): Launched 16:15:56.272016 run osmo-stp_10.42.42.5(pid=23319): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23319)] 16:15:56.404750 run osmo-stp_10.42.42.5(pid=23319): stdout: | (launched: 2022-12-10_16:15:54.874654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:56.537986 run osmo-stp_10.42.42.5(pid=23319): stderr: | [0;m[38;5;43m20221210161555066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161555066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161555067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161555067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161555067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161555067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161555068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:56.670745 run osmo-stp_10.42.42.5(pid=23319): stdout: | (launched: 2022-12-10_16:15:54.874654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:56.796559 run osmo-stp_10.42.42.5(pid=23319): stderr: | [0;m[38;5;43m20221210161555066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161555066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161555067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161555067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161555067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161555067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161555068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:56.946604 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23319): Process ended prematurely: osmo-stp_10.42.42.5(pid=23319) [trial-2376↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23319)] [trial-2376↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 16:15:56.955373 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 16:15:56.982713 run osmo-hlr_10.42.42.2(pid=23316): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23316)] 16:15:57.032554 run osmo-hlr_10.42.42.2(pid=23316): stdout: | (launched: 2022-12-10_16:15:53.900931) 16:15:57.084092 run osmo-hlr_10.42.42.2(pid=23316): stderr: | [0;m[1;31m20221210161554098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161554098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161554098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161554098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161554098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161554098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161554111 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161554119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161554119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161554119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:57.156185 run osmo-msc_10.42.42.6(pid=23322): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23322)] 16:15:57.206318 run osmo-msc_10.42.42.6(pid=23322): stdout: | (launched: 2022-12-10_16:15:56.040805) 16:15:57.258094 run osmo-msc_10.42.42.6(pid=23322): stderr: | [0;m[38;5;43m20221210161556361 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161556361 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd993a84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161556362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161556362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161556362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161556362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161556364 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161556364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161556364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161556364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:57.310168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23315): Terminating (SIGTERM) 16:15:57.351907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23318): Terminating (SIGTERM) 16:15:57.393745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23321): Terminating (SIGTERM) 16:15:57.435873 --- ParallelTerminationStrategy: PID 23315 died... 16:15:57.455938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23315): Terminated: ok {rc=0} 16:15:57.502483 --- ParallelTerminationStrategy: PID 23318 died... 16:15:57.522375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23318): Terminated: ok {rc=0} 16:15:57.568847 --- ParallelTerminationStrategy: PID 23321 died... 16:15:57.588757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23321): Terminated: ok {rc=0} 16:15:57.675408 bus /sierra_3: Setting Powered False 16:15:58.773981 bus /sierra_3: Setting Powered False 16:15:59.890259 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 16:16:00.990874 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:01.014142 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 16:16:01.076625 tst emergency_preemptive_call.py: using LAC 29138 16:16:01.197829 tst emergency_preemptive_call.py: using RAC 68 16:16:01.363182 tst emergency_preemptive_call.py: using CellId 29138 16:16:01.524150 tst emergency_preemptive_call.py: using BVCI 29139 16:16:01.637592 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:01.649704 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:01.664724 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:01.678109 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:01.691236 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:01.705932 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:01.857937 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:02.010765 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:02.148419 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:02.260868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:02.716883 run create_hlr_db(pid=23324): Launched 16:16:02.828314 bus /sierra_2: Setting Powered False 16:16:03.887923 run create_hlr_db(pid=23324): Terminated: ok {rc=0} 16:16:04.296904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23326): Launched 16:16:04.588856 run osmo-hlr_10.42.42.2(pid=23327): Launched 16:16:04.699991 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:05.201291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23329): Launched 16:16:05.491796 run osmo-stp_10.42.42.5(pid=23330): Launched 16:16:05.613029 tst emergency_preemptive_call.py: using MSISDN 7791 16:16:05.775720 run osmo-msc_10.42.42.6: Starting osmo-msc 16:16:06.299127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23332): Launched 16:16:06.590797 run osmo-msc_10.42.42.6(pid=23333): Launched 16:16:06.754156 run osmo-stp_10.42.42.5(pid=23330): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23330)] 16:16:06.878240 run osmo-stp_10.42.42.5(pid=23330): stdout: | (launched: 2022-12-10_16:16:05.438285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:07.002899 run osmo-stp_10.42.42.5(pid=23330): stderr: | [0;m[38;5;43m20221210161605607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161605608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161605608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161605608 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161605609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161605609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161605609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:07.124866 run osmo-stp_10.42.42.5(pid=23330): stdout: | (launched: 2022-12-10_16:16:05.438285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:07.241836 run osmo-stp_10.42.42.5(pid=23330): stderr: | [0;m[38;5;43m20221210161605607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161605608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161605608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161605608 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161605609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161605609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161605609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:07.380862 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23330): Process ended prematurely: osmo-stp_10.42.42.5(pid=23330) [trial-2376↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23330)] [trial-2376↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 16:16:07.389145 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 16:16:07.415828 run osmo-hlr_10.42.42.2(pid=23327): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23327)] 16:16:07.463928 run osmo-hlr_10.42.42.2(pid=23327): stdout: | (launched: 2022-12-10_16:16:04.535532) 16:16:07.513840 run osmo-hlr_10.42.42.2(pid=23327): stderr: | [0;m[1;31m20221210161604710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161604711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161604711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161604711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161604711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161604711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161604723 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161604732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161604732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161604732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:07.583266 run osmo-msc_10.42.42.6(pid=23333): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23333)] 16:16:07.631517 run osmo-msc_10.42.42.6(pid=23333): stdout: | (launched: 2022-12-10_16:16:06.536897) 16:16:07.681167 run osmo-msc_10.42.42.6(pid=23333): stderr: | [0;m[38;5;43m20221210161606806 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210161606807 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c22451c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210161606807 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210161606807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210161606807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210161606807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210161606809 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210161606810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210161606810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210161606810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:16:07.730870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23326): Terminating (SIGTERM) 16:16:07.770863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23329): Terminating (SIGTERM) 16:16:07.810848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23332): Terminating (SIGTERM) 16:16:07.850965 --- ParallelTerminationStrategy: PID 23326 died... 16:16:07.870237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23326): Terminated: ok {rc=0} 16:16:07.915128 --- ParallelTerminationStrategy: PID 23329 died... 16:16:07.933874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23329): Terminated: ok {rc=0} 16:16:07.978624 --- ParallelTerminationStrategy: PID 23332 died... 16:16:07.997358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23332): Terminated: ok {rc=0} 16:16:08.082275 bus /sierra_9: Setting Powered False 16:16:09.177955 bus /sierra_9: Setting Powered False 16:16:10.293627 bus /sierra_8: Setting Powered False 16:16:11.393102 bus /sierra_8: Setting Powered False 16:16:12.508941 bus /sierra_3: Setting Powered False 16:16:13.608986 bus /sierra_3: Setting Powered False 16:16:14.726181 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-umtrx --------------------------------------------------------------------- 16:16:16.046215 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:16.051645 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:16:16.088231 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 16:16:16.129249 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 16:16:16.218419 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:16:16.253408 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 16:16:16.294560 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 16:16:16.904675 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 16:16:16.958452 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:16.970070 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:16:17.019196 tst cs_paging_gprs_active.py: using LAC 29139 16:16:17.171947 tst cs_paging_gprs_active.py: using RAC 69 16:16:17.304738 tst cs_paging_gprs_active.py: using CellId 29139 16:16:17.425793 tst cs_paging_gprs_active.py: using BVCI 29140 16:16:17.537143 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:17.547935 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:17.558560 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:17.570018 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:17.580433 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:17.592037 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:17.603209 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:17.614168 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:17.625392 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:17.740201 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:17.855384 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:16:18.057456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:18.355916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23338): Launched 16:16:18.615217 run iperf3-srv_10.42.42.10(pid=23339): Launched 16:16:18.726574 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:16:18.926580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:19.224800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23340): Launched 16:16:19.483648 run iperf3-srv_10.42.42.10(pid=23341): Launched 16:16:19.594809 tst cs_paging_gprs_active.py:38: start network... 16:16:19.795810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:20.254901 run create_hlr_db(pid=23342): Launched 16:16:20.368227 bus /sierra_2: Setting Powered False 16:16:21.427909 run create_hlr_db(pid=23342): Terminated: ok {rc=0} 16:16:21.865619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23344): Launched 16:16:22.183654 run osmo-hlr_10.42.42.2(pid=23345): Launched 16:16:22.304211 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:22.850881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23347): Launched 16:16:23.167871 run osmo-stp_10.42.42.5(pid=23348): Launched 16:16:23.288641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:16:23.837128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23350): Launched 16:16:23.958239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:16:24.226052 run patchelf(pid=23351): Launched 16:16:24.403242 run osmo-stp_10.42.42.5(pid=23348): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23348)] 16:16:24.538469 run osmo-stp_10.42.42.5(pid=23348): stdout: | (launched: 2022-12-10_16:16:23.110222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:24.675862 run osmo-stp_10.42.42.5(pid=23348): stderr: | [0;m[38;5;43m20221210161623299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161623299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161623299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161623299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161623300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161623300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161623300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:24.813610 run osmo-stp_10.42.42.5(pid=23348): stdout: | (launched: 2022-12-10_16:16:23.110222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:24.944615 run osmo-stp_10.42.42.5(pid=23348): stderr: | [0;m[38;5;43m20221210161623299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161623299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161623299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161623299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161623300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161623300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161623300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:25.099789 run patchelf(pid=23351): Terminating (SIGINT) 16:16:25.279188 run patchelf(pid=23351): Terminated: ok {rc=0} 16:16:25.408362 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23348): Process ended prematurely: osmo-stp_10.42.42.5(pid=23348) [trial-2376↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23348)] [trial-2376↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 16:16:25.418625 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:16:25.447568 run osmo-hlr_10.42.42.2(pid=23345): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23345)] 16:16:25.497476 run osmo-hlr_10.42.42.2(pid=23345): stdout: | (launched: 2022-12-10_16:16:22.125762) 16:16:25.549096 run osmo-hlr_10.42.42.2(pid=23345): stderr: | [0;m[1;31m20221210161622323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161622323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161622323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161622323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161622323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161622323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161622336 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161622344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161622344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161622344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:25.600859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23338): Terminating (SIGTERM) 16:16:25.642736 run iperf3-srv_10.42.42.10(pid=23339): Terminating (SIGTERM) 16:16:25.685058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23340): Terminating (SIGTERM) 16:16:25.726800 run iperf3-srv_10.42.42.10(pid=23341): Terminating (SIGTERM) 16:16:25.770589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23344): Terminating (SIGTERM) 16:16:25.812481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23347): Terminating (SIGTERM) 16:16:25.854442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23350): Terminating (SIGTERM) 16:16:25.897089 --- ParallelTerminationStrategy: PID 23338 died... 16:16:25.917189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23338): Terminated: ok {rc=0} 16:16:25.964001 --- ParallelTerminationStrategy: PID 23339 died... 16:16:25.983633 run iperf3-srv_10.42.42.10(pid=23339): Terminated {rc=256} 16:16:26.029846 --- ParallelTerminationStrategy: PID 23340 died... 16:16:26.049528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23340): Terminated: ok {rc=0} 16:16:26.095927 --- ParallelTerminationStrategy: PID 23341 died... 16:16:26.115566 run iperf3-srv_10.42.42.10(pid=23341): Terminated {rc=256} 16:16:26.161820 --- ParallelTerminationStrategy: PID 23344 died... 16:16:26.181508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23344): Terminated: ok {rc=0} 16:16:26.227715 --- ParallelTerminationStrategy: PID 23347 died... 16:16:26.247356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23347): Terminated: ok {rc=0} 16:16:26.294006 --- ParallelTerminationStrategy: PID 23350 died... 16:16:26.313894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23350): Terminated: ok {rc=0} 16:16:26.402211 bus /gobi_0: Setting Powered False 16:16:27.503393 bus /gobi_0: Setting Powered False 16:16:28.617563 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx iperf3.py ---------------------------------------------- 16:16:29.768520 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:29.780388 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:16:29.836258 tst iperf3.py: using LAC 29140 16:16:29.961060 tst iperf3.py: using RAC 70 16:16:30.084053 tst iperf3.py: using CellId 29140 16:16:30.209374 tst iperf3.py: using BVCI 29141 16:16:30.327765 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:30.338834 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:30.349697 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:30.360434 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:30.371134 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:30.381867 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:30.392721 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:30.403546 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:30.414453 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:30.527874 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:16:30.728529 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:31.082295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23352): Launched 16:16:31.376379 run iperf3-srv_10.42.42.10(pid=23353): Launched 16:16:31.511530 tst iperf3.py:8: start network... 16:16:31.732872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:32.238513 run create_hlr_db(pid=23354): Launched 16:16:32.367390 bus /gobi_6: Setting Powered False 16:16:33.427552 run create_hlr_db(pid=23354): Terminated: ok {rc=0} 16:16:33.871310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23356): Launched 16:16:34.190040 run osmo-hlr_10.42.42.2(pid=23357): Launched 16:16:34.311241 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:34.863303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23359): Launched 16:16:35.180266 run osmo-stp_10.42.42.5(pid=23360): Launched 16:16:35.301705 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:16:35.850650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23362): Launched 16:16:35.973060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:16:36.241725 run patchelf(pid=23363): Launched 16:16:36.418319 run osmo-stp_10.42.42.5(pid=23360): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23360)] 16:16:36.553667 run osmo-stp_10.42.42.5(pid=23360): stdout: | (launched: 2022-12-10_16:16:35.122482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:36.691063 run osmo-stp_10.42.42.5(pid=23360): stderr: | [0;m[38;5;43m20221210161635314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161635315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161635315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161635315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161635316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161635316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161635316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:36.828801 run osmo-stp_10.42.42.5(pid=23360): stdout: | (launched: 2022-12-10_16:16:35.122482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:36.959797 run osmo-stp_10.42.42.5(pid=23360): stderr: | [0;m[38;5;43m20221210161635314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161635315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161635315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161635315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161635316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161635316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161635316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:37.115130 run patchelf(pid=23363): Terminating (SIGINT) 16:16:37.294078 run patchelf(pid=23363): Terminated: ok {rc=0} 16:16:37.423258 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23360): Process ended prematurely: osmo-stp_10.42.42.5(pid=23360) [trial-2376↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23360)] [trial-2376↪gprs:trx-umtrx↪iperf3.py:8] 16:16:37.433104 tst iperf3.py:8: Test FAILED (7.7 sec) 16:16:37.461495 run osmo-hlr_10.42.42.2(pid=23357): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23357)] 16:16:37.511502 run osmo-hlr_10.42.42.2(pid=23357): stdout: | (launched: 2022-12-10_16:16:34.132321) 16:16:37.563133 run osmo-hlr_10.42.42.2(pid=23357): stderr: | [0;m[1;31m20221210161634329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161634329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161634329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161634329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161634329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161634330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161634342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161634350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161634350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161634351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:37.615263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23352): Terminating (SIGTERM) 16:16:37.657118 run iperf3-srv_10.42.42.10(pid=23353): Terminating (SIGTERM) 16:16:37.699100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23356): Terminating (SIGTERM) 16:16:37.741008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23359): Terminating (SIGTERM) 16:16:37.783137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23362): Terminating (SIGTERM) 16:16:37.825617 --- ParallelTerminationStrategy: PID 23352 died... 16:16:37.845941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23352): Terminated: ok {rc=0} 16:16:37.892859 --- ParallelTerminationStrategy: PID 23353 died... 16:16:37.912528 run iperf3-srv_10.42.42.10(pid=23353): Terminated {rc=256} 16:16:37.958846 --- ParallelTerminationStrategy: PID 23356 died... 16:16:37.978554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23356): Terminated: ok {rc=0} 16:16:38.024927 --- ParallelTerminationStrategy: PID 23359 died... 16:16:38.045075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23359): Terminated: ok {rc=0} 16:16:38.091403 --- ParallelTerminationStrategy: PID 23362 died... 16:16:38.111189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23362): Terminated: ok {rc=0} 16:16:38.198945 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 16:16:39.350783 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.362711 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:16:39.409755 tst iperf3m4.py: using LAC 29141 16:16:39.534440 tst iperf3m4.py: using RAC 71 16:16:39.658064 tst iperf3m4.py: using CellId 29141 16:16:39.783017 tst iperf3m4.py: using BVCI 29142 16:16:39.899426 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.910726 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.921786 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.932567 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.943548 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.955178 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.966458 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.977561 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.988579 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:40.107165 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:40.230973 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:40.346719 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:40.461647 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:16:40.663652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:40.964734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23364): Launched 16:16:41.224780 run iperf3-srv_10.42.42.10(pid=23365): Launched 16:16:41.336537 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:16:41.537323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:41.836860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23366): Launched 16:16:42.097022 run iperf3-srv_10.42.42.10(pid=23367): Launched 16:16:42.208420 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:16:42.407188 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:42.705647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23368): Launched 16:16:42.965214 run iperf3-srv_10.42.42.10(pid=23369): Launched 16:16:43.076341 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:16:43.275507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:43.573559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23370): Launched 16:16:43.833241 run iperf3-srv_10.42.42.10(pid=23371): Launched 16:16:43.944790 tst iperf3m4.py:8: start network... 16:16:44.144441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:44.604645 run create_hlr_db(pid=23372): Launched 16:16:44.726083 bus /gobi_6: Setting Powered False 16:16:45.785827 run create_hlr_db(pid=23372): Terminated: ok {rc=0} 16:16:46.246247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23374): Launched 16:16:46.587000 run osmo-hlr_10.42.42.2(pid=23375): Launched 16:16:46.814346 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:47.438828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23377): Launched 16:16:47.757686 run osmo-stp_10.42.42.5(pid=23378): Launched 16:16:47.879244 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:16:48.429970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23380): Launched 16:16:48.551386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:16:48.820219 run patchelf(pid=23381): Launched 16:16:48.997578 run osmo-stp_10.42.42.5(pid=23378): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23378)] 16:16:49.132833 run osmo-stp_10.42.42.5(pid=23378): stdout: | (launched: 2022-12-10_16:16:47.699840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:49.269978 run osmo-stp_10.42.42.5(pid=23378): stderr: | [0;m[38;5;43m20221210161647885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161647885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161647886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161647886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161647887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161647887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161647887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:49.406869 run osmo-stp_10.42.42.5(pid=23378): stdout: | (launched: 2022-12-10_16:16:47.699840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:49.537454 run osmo-stp_10.42.42.5(pid=23378): stderr: | [0;m[38;5;43m20221210161647885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161647885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161647886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161647886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161647887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161647887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161647887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:49.692191 run patchelf(pid=23381): Terminating (SIGINT) 16:16:49.871825 run patchelf(pid=23381): Terminated: ok {rc=0} 16:16:50.001569 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23378): Process ended prematurely: osmo-stp_10.42.42.5(pid=23378) [trial-2376↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23378)] [trial-2376↪gprs:trx-umtrx↪iperf3m4.py:8] 16:16:50.011562 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:16:50.040280 run osmo-hlr_10.42.42.2(pid=23375): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23375)] 16:16:50.090110 run osmo-hlr_10.42.42.2(pid=23375): stdout: | (launched: 2022-12-10_16:16:46.525047) 16:16:50.141698 run osmo-hlr_10.42.42.2(pid=23375): stderr: | [0;m[1;31m20221210161646727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161646727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161646727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161646727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161646727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161646727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161646739 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161646756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161646756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161646756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:50.193611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23364): Terminating (SIGTERM) 16:16:50.235627 run iperf3-srv_10.42.42.10(pid=23365): Terminating (SIGTERM) 16:16:50.277383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23366): Terminating (SIGTERM) 16:16:50.319426 run iperf3-srv_10.42.42.10(pid=23367): Terminating (SIGTERM) 16:16:50.362513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23368): Terminating (SIGTERM) 16:16:50.404427 run iperf3-srv_10.42.42.10(pid=23369): Terminating (SIGTERM) 16:16:50.445898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23370): Terminating (SIGTERM) 16:16:50.487563 run iperf3-srv_10.42.42.10(pid=23371): Terminating (SIGTERM) 16:16:50.528723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23374): Terminating (SIGTERM) 16:16:50.570610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23377): Terminating (SIGTERM) 16:16:50.612339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23380): Terminating (SIGTERM) 16:16:50.653994 --- ParallelTerminationStrategy: PID 23364 died... 16:16:50.673866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23364): Terminated: ok {rc=0} 16:16:50.719992 --- ParallelTerminationStrategy: PID 23365 died... 16:16:50.739492 run iperf3-srv_10.42.42.10(pid=23365): Terminated {rc=256} 16:16:50.785388 --- ParallelTerminationStrategy: PID 23366 died... 16:16:50.804755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23366): Terminated: ok {rc=0} 16:16:50.851399 --- ParallelTerminationStrategy: PID 23367 died... 16:16:50.870875 run iperf3-srv_10.42.42.10(pid=23367): Terminated {rc=256} 16:16:50.916875 --- ParallelTerminationStrategy: PID 23368 died... 16:16:50.936522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23368): Terminated: ok {rc=0} 16:16:50.982836 --- ParallelTerminationStrategy: PID 23369 died... 16:16:51.002473 run iperf3-srv_10.42.42.10(pid=23369): Terminated {rc=256} 16:16:51.048458 --- ParallelTerminationStrategy: PID 23370 died... 16:16:51.067952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23370): Terminated: ok {rc=0} 16:16:51.114165 --- ParallelTerminationStrategy: PID 23371 died... 16:16:51.133773 run iperf3-srv_10.42.42.10(pid=23371): Terminated {rc=256} 16:16:51.179915 --- ParallelTerminationStrategy: PID 23374 died... 16:16:51.199589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23374): Terminated: ok {rc=0} 16:16:51.246372 --- ParallelTerminationStrategy: PID 23377 died... 16:16:51.266249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23377): Terminated: ok {rc=0} 16:16:51.312500 --- ParallelTerminationStrategy: PID 23380 died... 16:16:51.332257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23380): Terminated: ok {rc=0} 16:16:51.419789 bus /gobi_4: Setting Powered False 16:16:52.518510 bus /gobi_4: Setting Powered False 16:16:53.634829 bus /gobi_1: Setting Powered False 16:16:54.731078 bus /gobi_1: Setting Powered False 16:16:55.846797 bus /gobi_0: Setting Powered False 16:16:56.944810 bus /gobi_0: Setting Powered False 16:16:58.060839 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx ping.py ---------------------------------------------- 16:16:59.163280 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:59.174451 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:16:59.222514 tst ping.py: using LAC 29142 16:16:59.338184 tst ping.py: using RAC 72 16:16:59.454782 tst ping.py: using CellId 29142 16:16:59.572412 tst ping.py: using BVCI 29143 16:16:59.680279 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:59.690806 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:59.701235 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:59.711752 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:59.722328 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:59.732817 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:59.743530 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:59.754735 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:59.869575 tst ping.py:19: start network... 16:17:00.081123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:00.564819 run create_hlr_db(pid=23382): Launched 16:17:00.691420 bus /gobi_6: Setting Powered False 16:17:01.753624 run create_hlr_db(pid=23382): Terminated: ok {rc=0} 16:17:02.202729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23388): Launched 16:17:02.524109 run osmo-hlr_10.42.42.2(pid=23389): Launched 16:17:02.643700 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:03.206304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23391): Launched 16:17:03.517564 run osmo-stp_10.42.42.5(pid=23392): Launched 16:17:03.637347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:17:04.178078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23394): Launched 16:17:04.297319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:17:04.561626 run patchelf(pid=23395): Launched 16:17:04.735251 run osmo-stp_10.42.42.5(pid=23392): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23392)] 16:17:04.868592 run osmo-stp_10.42.42.5(pid=23392): stdout: | (launched: 2022-12-10_16:17:03.460701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:05.003164 run osmo-stp_10.42.42.5(pid=23392): stderr: | [0;m[38;5;43m20221210161703650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161703650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161703650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161703651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161703651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161703651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161703651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:05.137730 run osmo-stp_10.42.42.5(pid=23392): stdout: | (launched: 2022-12-10_16:17:03.460701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:05.266358 run osmo-stp_10.42.42.5(pid=23392): stderr: | [0;m[38;5;43m20221210161703650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161703650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161703650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161703651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161703651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161703651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161703651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:05.418906 run patchelf(pid=23395): Terminating (SIGINT) 16:17:05.594955 run patchelf(pid=23395): Terminated: ok {rc=0} 16:17:05.721456 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23392): Process ended prematurely: osmo-stp_10.42.42.5(pid=23392) [trial-2376↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23392)] [trial-2376↪gprs:trx-umtrx↪ping.py:22] 16:17:05.730745 tst ping.py:22: Test FAILED (6.6 sec) 16:17:05.758568 run osmo-hlr_10.42.42.2(pid=23389): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23389)] 16:17:05.808159 run osmo-hlr_10.42.42.2(pid=23389): stdout: | (launched: 2022-12-10_16:17:02.467576) 16:17:05.858982 run osmo-hlr_10.42.42.2(pid=23389): stderr: | [0;m[1;31m20221210161702663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161702663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161702663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161702663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161702663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161702664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161702688 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161702716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161702716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161702716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:05.910178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23388): Terminating (SIGTERM) 16:17:05.951574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23391): Terminating (SIGTERM) 16:17:05.992925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23394): Terminating (SIGTERM) 16:17:06.034716 --- ParallelTerminationStrategy: PID 23388 died... 16:17:06.054613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23388): Terminated: ok {rc=0} 16:17:06.101145 --- ParallelTerminationStrategy: PID 23391 died... 16:17:06.120737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23391): Terminated: ok {rc=0} 16:17:06.166855 --- ParallelTerminationStrategy: PID 23394 died... 16:17:06.186494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23394): Terminated: ok {rc=0} 16:17:06.275046 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 16:17:07.362976 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:07.375243 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:17:07.425710 tst ping_idle_ping.py: using LAC 29143 16:17:07.550223 tst ping_idle_ping.py: using RAC 73 16:17:07.673052 tst ping_idle_ping.py: using CellId 29143 16:17:07.798454 tst ping_idle_ping.py: using BVCI 29144 16:17:07.913921 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:07.925181 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:07.936083 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:07.947092 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:07.958143 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:07.969133 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:07.980179 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:07.991268 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:17:08.105803 tst ping_idle_ping.py:24: start network... 16:17:08.302989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:08.758799 run create_hlr_db(pid=23396): Launched 16:17:08.870598 bus /gobi_6: Setting Powered False 16:17:09.929700 run create_hlr_db(pid=23396): Terminated: ok {rc=0} 16:17:10.361055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23398): Launched 16:17:10.674886 run osmo-hlr_10.42.42.2(pid=23399): Launched 16:17:10.794449 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:11.333691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23401): Launched 16:17:11.647394 run osmo-stp_10.42.42.5(pid=23402): Launched 16:17:11.767130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:17:12.310071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23404): Launched 16:17:12.429699 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:17:12.694371 run patchelf(pid=23405): Launched 16:17:12.869402 run osmo-stp_10.42.42.5(pid=23402): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23402)] 16:17:13.002613 run osmo-stp_10.42.42.5(pid=23402): stdout: | (launched: 2022-12-10_16:17:11.590216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:13.137252 run osmo-stp_10.42.42.5(pid=23402): stderr: | [0;m[38;5;43m20221210161711783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161711783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161711783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161711783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161711786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161711786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161711786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:13.272184 run osmo-stp_10.42.42.5(pid=23402): stdout: | (launched: 2022-12-10_16:17:11.590216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:13.401437 run osmo-stp_10.42.42.5(pid=23402): stderr: | [0;m[38;5;43m20221210161711783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161711783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161711783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161711783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161711786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161711786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161711786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:13.554459 run patchelf(pid=23405): Terminating (SIGINT) 16:17:13.730582 run patchelf(pid=23405): Terminated: ok {rc=0} 16:17:13.858078 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23402): Process ended prematurely: osmo-stp_10.42.42.5(pid=23402) [trial-2376↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23402)] [trial-2376↪gprs:trx-umtrx↪ping_idle_ping.py:27] 16:17:13.867351 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:17:13.895418 run osmo-hlr_10.42.42.2(pid=23399): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23399)] 16:17:13.945601 run osmo-hlr_10.42.42.2(pid=23399): stdout: | (launched: 2022-12-10_16:17:10.618001) 16:17:13.997583 run osmo-hlr_10.42.42.2(pid=23399): stderr: | [0;m[1;31m20221210161710812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161710812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161710812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161710812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161710812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161710812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161710828 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161710838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161710838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161710839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:14.049981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23398): Terminating (SIGTERM) 16:17:14.092072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23401): Terminating (SIGTERM) 16:17:14.134439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23404): Terminating (SIGTERM) 16:17:14.176936 --- ParallelTerminationStrategy: PID 23398 died... 16:17:14.197179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23398): Terminated: ok {rc=0} 16:17:14.244043 --- ParallelTerminationStrategy: PID 23401 died... 16:17:14.263700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23401): Terminated: ok {rc=0} 16:17:14.310242 --- ParallelTerminationStrategy: PID 23404 died... 16:17:14.330066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23404): Terminated: ok {rc=0} 16:17:14.418501 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 16:17:15.720912 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:17:15.726923 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:17:15.760384 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:17:15.799760 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:17:15.901085 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:17:15.947299 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:17:15.988289 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:17:16.555901 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:17:16.609231 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:16.621405 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:17:16.673824 tst cs_paging_gprs_active.py: using LAC 29144 16:17:16.795829 tst cs_paging_gprs_active.py: using RAC 74 16:17:16.918184 tst cs_paging_gprs_active.py: using CellId 29144 16:17:17.081269 tst cs_paging_gprs_active.py: using BVCI 29145 16:17:17.217475 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:17.229476 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:17.240938 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:17.252542 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:17.264905 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:17.276852 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:17.288149 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:17.299150 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:17.310380 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:17.427795 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:17.544472 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:17:17.761744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:18.083323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23410): Launched 16:17:18.361362 run iperf3-srv_10.42.42.10(pid=23411): Launched 16:17:18.480770 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:17:18.696603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:19.017685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23412): Launched 16:17:19.294900 run iperf3-srv_10.42.42.10(pid=23413): Launched 16:17:19.414021 tst cs_paging_gprs_active.py:38: start network... 16:17:19.629693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:20.123834 run create_hlr_db(pid=23414): Launched 16:17:20.253298 bus /gobi_6: Setting Powered False 16:17:21.316790 run create_hlr_db(pid=23414): Terminated: ok {rc=0} 16:17:21.745190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23416): Launched 16:17:22.043660 run osmo-hlr_10.42.42.2(pid=23417): Launched 16:17:22.157779 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:22.686356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23419): Launched 16:17:22.984114 run osmo-stp_10.42.42.5(pid=23420): Launched 16:17:23.097191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:17:23.609934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23422): Launched 16:17:23.723946 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:17:23.975244 run patchelf(pid=23423): Launched 16:17:24.140471 run osmo-stp_10.42.42.5(pid=23420): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23420)] 16:17:24.267636 run osmo-stp_10.42.42.5(pid=23420): stdout: | (launched: 2022-12-10_16:17:22.929653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:24.396068 run osmo-stp_10.42.42.5(pid=23420): stderr: | [0;m[38;5;43m20221210161723097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161723098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161723098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161723098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161723099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161723099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161723099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:24.524794 run osmo-stp_10.42.42.5(pid=23420): stdout: | (launched: 2022-12-10_16:17:22.929653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:24.647209 run osmo-stp_10.42.42.5(pid=23420): stderr: | [0;m[38;5;43m20221210161723097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161723098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161723098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161723098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161723099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161723099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161723099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:24.792200 run patchelf(pid=23423): Terminating (SIGINT) 16:17:24.959874 run patchelf(pid=23423): Terminated: ok {rc=0} 16:17:25.081064 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23420): Process ended prematurely: osmo-stp_10.42.42.5(pid=23420) [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23420)] [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:17:25.090551 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:17:25.118208 run osmo-hlr_10.42.42.2(pid=23417): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23417)] 16:17:25.165761 run osmo-hlr_10.42.42.2(pid=23417): stdout: | (launched: 2022-12-10_16:17:21.989090) 16:17:25.215045 run osmo-hlr_10.42.42.2(pid=23417): stderr: | [0;m[1;31m20221210161722165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161722165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161722165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161722165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161722165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161722165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161722177 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161722186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161722186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161722186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:25.264803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23410): Terminating (SIGTERM) 16:17:25.304730 run iperf3-srv_10.42.42.10(pid=23411): Terminating (SIGTERM) 16:17:25.345172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23412): Terminating (SIGTERM) 16:17:25.385319 run iperf3-srv_10.42.42.10(pid=23413): Terminating (SIGTERM) 16:17:25.425225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23416): Terminating (SIGTERM) 16:17:25.465665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23419): Terminating (SIGTERM) 16:17:25.505490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23422): Terminating (SIGTERM) 16:17:25.545676 --- ParallelTerminationStrategy: PID 23410 died... 16:17:25.564804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23410): Terminated: ok {rc=0} 16:17:25.608910 --- ParallelTerminationStrategy: PID 23411 died... 16:17:25.627972 run iperf3-srv_10.42.42.10(pid=23411): Terminated {rc=256} 16:17:25.672365 --- ParallelTerminationStrategy: PID 23412 died... 16:17:25.691029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23412): Terminated: ok {rc=0} 16:17:25.735083 --- ParallelTerminationStrategy: PID 23413 died... 16:17:25.753581 run iperf3-srv_10.42.42.10(pid=23413): Terminated {rc=256} 16:17:25.797551 --- ParallelTerminationStrategy: PID 23416 died... 16:17:25.816120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23416): Terminated: ok {rc=0} 16:17:25.860630 --- ParallelTerminationStrategy: PID 23419 died... 16:17:25.879235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23419): Terminated: ok {rc=0} 16:17:25.923352 --- ParallelTerminationStrategy: PID 23422 died... 16:17:25.942074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23422): Terminated: ok {rc=0} 16:17:26.025092 bus /gobi_0: Setting Powered False 16:17:27.122231 bus /gobi_0: Setting Powered False 16:17:28.237281 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:17:29.385094 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:29.397112 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:17:29.450486 tst iperf3.py: using LAC 29145 16:17:29.577117 tst iperf3.py: using RAC 75 16:17:29.702528 tst iperf3.py: using CellId 29145 16:17:29.840597 tst iperf3.py: using BVCI 29146 16:17:29.959249 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:29.970612 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:29.981622 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:29.992728 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:30.003713 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:30.014702 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:30.026025 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:30.036828 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:30.048049 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:30.164372 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:17:30.380884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:30.700274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23424): Launched 16:17:30.989495 run iperf3-srv_10.42.42.10(pid=23425): Launched 16:17:31.152349 tst iperf3.py:8: start network... 16:17:31.391070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:31.897640 run create_hlr_db(pid=23426): Launched 16:17:32.058308 bus /gobi_6: Setting Powered False 16:17:33.122043 run create_hlr_db(pid=23426): Terminated: ok {rc=0} 16:17:33.565112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23428): Launched 16:17:33.882718 run osmo-hlr_10.42.42.2(pid=23429): Launched 16:17:34.002935 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:34.559965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23431): Launched 16:17:34.878681 run osmo-stp_10.42.42.5(pid=23432): Launched 16:17:34.999806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:17:35.548644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23434): Launched 16:17:35.670634 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:17:35.939952 run patchelf(pid=23435): Launched 16:17:36.118596 run osmo-stp_10.42.42.5(pid=23432): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23432)] 16:17:36.252927 run osmo-stp_10.42.42.5(pid=23432): stdout: | (launched: 2022-12-10_16:17:34.820652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:36.390171 run osmo-stp_10.42.42.5(pid=23432): stderr: | [0;m[38;5;43m20221210161735010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161735010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161735010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161735011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161735011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161735011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161735011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:36.526687 run osmo-stp_10.42.42.5(pid=23432): stdout: | (launched: 2022-12-10_16:17:34.820652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:36.656738 run osmo-stp_10.42.42.5(pid=23432): stderr: | [0;m[38;5;43m20221210161735010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161735010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161735010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161735011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161735011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161735011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161735011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:36.811435 run patchelf(pid=23435): Terminating (SIGINT) 16:17:36.990071 run patchelf(pid=23435): Terminated: ok {rc=0} 16:17:37.118773 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23432): Process ended prematurely: osmo-stp_10.42.42.5(pid=23432) [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23432)] [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 16:17:37.128892 tst iperf3.py:8: Test FAILED (7.8 sec) 16:17:37.157707 run osmo-hlr_10.42.42.2(pid=23429): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23429)] 16:17:37.207508 run osmo-hlr_10.42.42.2(pid=23429): stdout: | (launched: 2022-12-10_16:17:33.824816) 16:17:37.259115 run osmo-hlr_10.42.42.2(pid=23429): stderr: | [0;m[1;31m20221210161734020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161734020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161734020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161734021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161734021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161734021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161734033 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161734042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161734042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161734042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:37.311121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23424): Terminating (SIGTERM) 16:17:37.353383 run iperf3-srv_10.42.42.10(pid=23425): Terminating (SIGTERM) 16:17:37.395086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23428): Terminating (SIGTERM) 16:17:37.436842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23431): Terminating (SIGTERM) 16:17:37.478589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23434): Terminating (SIGTERM) 16:17:37.520622 --- ParallelTerminationStrategy: PID 23424 died... 16:17:37.540641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23424): Terminated: ok {rc=0} 16:17:37.587081 --- ParallelTerminationStrategy: PID 23425 died... 16:17:37.606695 run iperf3-srv_10.42.42.10(pid=23425): Terminated {rc=256} 16:17:37.652596 --- ParallelTerminationStrategy: PID 23428 died... 16:17:37.672180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23428): Terminated: ok {rc=0} 16:17:37.718028 --- ParallelTerminationStrategy: PID 23431 died... 16:17:37.737653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23431): Terminated: ok {rc=0} 16:17:37.783867 --- ParallelTerminationStrategy: PID 23434 died... 16:17:37.803702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23434): Terminated: ok {rc=0} 16:17:37.891093 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:17:39.042589 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.054736 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:17:39.107049 tst iperf3m4.py: using LAC 29146 16:17:39.231713 tst iperf3m4.py: using RAC 76 16:17:39.354848 tst iperf3m4.py: using CellId 29146 16:17:39.478422 tst iperf3m4.py: using BVCI 29147 16:17:39.595498 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.606818 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.617793 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.628732 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.639773 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.650735 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.661915 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.672746 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.683972 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:39.798821 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:39.915045 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:40.033070 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:40.149698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:17:40.351667 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:40.651409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23439): Launched 16:17:40.911477 run iperf3-srv_10.42.42.10(pid=23440): Launched 16:17:41.024081 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:17:41.223385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:41.522468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23441): Launched 16:17:41.782103 run iperf3-srv_10.42.42.10(pid=23442): Launched 16:17:41.893713 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:17:42.093334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:42.393185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23443): Launched 16:17:42.652688 run iperf3-srv_10.42.42.10(pid=23444): Launched 16:17:42.765113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:17:42.964255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:43.262634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23445): Launched 16:17:43.521220 run iperf3-srv_10.42.42.10(pid=23446): Launched 16:17:43.632541 tst iperf3m4.py:8: start network... 16:17:43.832081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:44.292902 run create_hlr_db(pid=23447): Launched 16:17:44.407650 bus /gobi_6: Setting Powered False 16:17:45.467449 run create_hlr_db(pid=23447): Terminated: ok {rc=0} 16:17:45.919422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23449): Launched 16:17:46.265866 run osmo-hlr_10.42.42.2(pid=23450): Launched 16:17:46.442909 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:47.139175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23452): Launched 16:17:47.470713 run osmo-stp_10.42.42.5(pid=23453): Launched 16:17:47.596460 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:17:48.146795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23455): Launched 16:17:48.268416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:17:48.538406 run patchelf(pid=23456): Launched 16:17:48.714770 run osmo-stp_10.42.42.5(pid=23453): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23453)] 16:17:48.850112 run osmo-stp_10.42.42.5(pid=23453): stdout: | (launched: 2022-12-10_16:17:47.412554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:48.987091 run osmo-stp_10.42.42.5(pid=23453): stderr: | [0;m[38;5;43m20221210161747599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161747599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161747600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161747600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161747600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161747601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161747601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:49.123634 run osmo-stp_10.42.42.5(pid=23453): stdout: | (launched: 2022-12-10_16:17:47.412554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:49.254440 run osmo-stp_10.42.42.5(pid=23453): stderr: | [0;m[38;5;43m20221210161747599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161747599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161747600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161747600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161747600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161747601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161747601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:49.409755 run patchelf(pid=23456): Terminating (SIGINT) 16:17:49.588475 run patchelf(pid=23456): Terminated: ok {rc=0} 16:17:49.718024 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23453): Process ended prematurely: osmo-stp_10.42.42.5(pid=23453) [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23453)] [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 16:17:49.728041 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:17:49.756851 run osmo-hlr_10.42.42.2(pid=23450): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23450)] 16:17:49.807015 run osmo-hlr_10.42.42.2(pid=23450): stdout: | (launched: 2022-12-10_16:17:46.202434) 16:17:49.858877 run osmo-hlr_10.42.42.2(pid=23450): stderr: | [0;m[1;31m20221210161746542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161746542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161746542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161746542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161746542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161746542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161746563 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161746575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161746575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161746576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:49.911412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23439): Terminating (SIGTERM) 16:17:49.953145 run iperf3-srv_10.42.42.10(pid=23440): Terminating (SIGTERM) 16:17:49.994958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23441): Terminating (SIGTERM) 16:17:50.036731 run iperf3-srv_10.42.42.10(pid=23442): Terminating (SIGTERM) 16:17:50.078322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23443): Terminating (SIGTERM) 16:17:50.120122 run iperf3-srv_10.42.42.10(pid=23444): Terminating (SIGTERM) 16:17:50.161624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23445): Terminating (SIGTERM) 16:17:50.203773 run iperf3-srv_10.42.42.10(pid=23446): Terminating (SIGTERM) 16:17:50.245607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23449): Terminating (SIGTERM) 16:17:50.287283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23452): Terminating (SIGTERM) 16:17:50.329535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23455): Terminating (SIGTERM) 16:17:50.371641 --- ParallelTerminationStrategy: PID 23439 died... 16:17:50.391782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23439): Terminated: ok {rc=0} 16:17:50.439149 --- ParallelTerminationStrategy: PID 23440 died... 16:17:50.458764 run iperf3-srv_10.42.42.10(pid=23440): Terminated {rc=256} 16:17:50.504560 --- ParallelTerminationStrategy: PID 23441 died... 16:17:50.524276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23441): Terminated: ok {rc=0} 16:17:50.570570 --- ParallelTerminationStrategy: PID 23442 died... 16:17:50.590170 run iperf3-srv_10.42.42.10(pid=23442): Terminated {rc=256} 16:17:50.636133 --- ParallelTerminationStrategy: PID 23443 died... 16:17:50.655786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23443): Terminated: ok {rc=0} 16:17:50.701979 --- ParallelTerminationStrategy: PID 23444 died... 16:17:50.721602 run iperf3-srv_10.42.42.10(pid=23444): Terminated {rc=256} 16:17:50.767623 --- ParallelTerminationStrategy: PID 23445 died... 16:17:50.787338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23445): Terminated: ok {rc=0} 16:17:50.833849 --- ParallelTerminationStrategy: PID 23446 died... 16:17:50.853365 run iperf3-srv_10.42.42.10(pid=23446): Terminated {rc=256} 16:17:50.899620 --- ParallelTerminationStrategy: PID 23449 died... 16:17:50.919333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23449): Terminated: ok {rc=0} 16:17:50.965700 --- ParallelTerminationStrategy: PID 23452 died... 16:17:50.985440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23452): Terminated: ok {rc=0} 16:17:51.031626 --- ParallelTerminationStrategy: PID 23455 died... 16:17:51.051355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23455): Terminated: ok {rc=0} 16:17:51.138916 bus /gobi_4: Setting Powered False 16:17:52.237694 bus /gobi_4: Setting Powered False 16:17:53.352878 bus /gobi_1: Setting Powered False 16:17:54.448318 bus /gobi_1: Setting Powered False 16:17:55.561602 bus /gobi_0: Setting Powered False 16:17:56.659342 bus /gobi_0: Setting Powered False 16:17:57.777712 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 16:17:58.879785 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:58.891331 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:17:58.942120 tst ping.py: using LAC 29147 16:17:59.064863 tst ping.py: using RAC 77 16:17:59.188085 tst ping.py: using CellId 29147 16:17:59.312443 tst ping.py: using BVCI 29148 16:17:59.426233 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:59.438052 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:59.449451 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:59.460546 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:59.471641 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:59.482718 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:59.494007 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:59.505174 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:59.619441 tst ping.py:19: start network... 16:17:59.815689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:00.269215 run create_hlr_db(pid=23457): Launched 16:18:00.382263 bus /gobi_6: Setting Powered False 16:18:01.444044 run create_hlr_db(pid=23457): Terminated: ok {rc=0} 16:18:01.873780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23459): Launched 16:18:02.183966 run osmo-hlr_10.42.42.2(pid=23460): Launched 16:18:02.312869 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:02.856438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23462): Launched 16:18:03.169685 run osmo-stp_10.42.42.5(pid=23463): Launched 16:18:03.289236 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:03.829630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23465): Launched 16:18:03.949220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:04.214276 run patchelf(pid=23466): Launched 16:18:04.388233 run osmo-stp_10.42.42.5(pid=23463): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23463)] 16:18:04.520648 run osmo-stp_10.42.42.5(pid=23463): stdout: | (launched: 2022-12-10_16:18:03.111946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:04.655391 run osmo-stp_10.42.42.5(pid=23463): stderr: | [0;m[38;5;43m20221210161803304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161803305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161803305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161803305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161803306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161803306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161803306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:04.789478 run osmo-stp_10.42.42.5(pid=23463): stdout: | (launched: 2022-12-10_16:18:03.111946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:04.918413 run osmo-stp_10.42.42.5(pid=23463): stderr: | [0;m[38;5;43m20221210161803304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161803305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161803305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161803305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161803306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161803306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161803306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:05.076872 run patchelf(pid=23466): Terminating (SIGINT) 16:18:05.241103 run patchelf(pid=23466): Terminated: ok {rc=0} 16:18:05.359646 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23463): Process ended prematurely: osmo-stp_10.42.42.5(pid=23463) [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23463)] [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 16:18:05.368685 tst ping.py:22: Test FAILED (6.5 sec) 16:18:05.395912 run osmo-hlr_10.42.42.2(pid=23460): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23460)] 16:18:05.444205 run osmo-hlr_10.42.42.2(pid=23460): stdout: | (launched: 2022-12-10_16:18:02.124076) 16:18:05.493911 run osmo-hlr_10.42.42.2(pid=23460): stderr: | [0;m[1;31m20221210161802329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161802329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161802329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161802329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161802329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161802330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161802342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161802350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161802350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161802350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:05.543762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23459): Terminating (SIGTERM) 16:18:05.584000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23462): Terminating (SIGTERM) 16:18:05.624073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23465): Terminating (SIGTERM) 16:18:05.664494 --- ParallelTerminationStrategy: PID 23459 died... 16:18:05.683890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23459): Terminated: ok {rc=0} 16:18:05.729366 --- ParallelTerminationStrategy: PID 23462 died... 16:18:05.748204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23462): Terminated: ok {rc=0} 16:18:05.793036 --- ParallelTerminationStrategy: PID 23465 died... 16:18:05.811902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23465): Terminated: ok {rc=0} 16:18:05.895229 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:18:06.982378 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:06.995077 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:18:07.052115 tst ping_idle_ping.py: using LAC 29148 16:18:07.175290 tst ping_idle_ping.py: using RAC 78 16:18:07.300634 tst ping_idle_ping.py: using CellId 29148 16:18:07.423928 tst ping_idle_ping.py: using BVCI 29149 16:18:07.538215 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:07.549584 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:07.560619 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:07.572220 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:07.583707 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:07.595241 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:07.607110 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:07.618789 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:18:07.732259 tst ping_idle_ping.py:24: start network... 16:18:07.929190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:08.386341 run create_hlr_db(pid=23467): Launched 16:18:08.498634 bus /gobi_6: Setting Powered False 16:18:09.557604 run create_hlr_db(pid=23467): Terminated: ok {rc=0} 16:18:09.969402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23469): Launched 16:18:10.263854 run osmo-hlr_10.42.42.2(pid=23470): Launched 16:18:10.375926 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:10.891397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23472): Launched 16:18:11.184805 run osmo-stp_10.42.42.5(pid=23473): Launched 16:18:11.296814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:11.803510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23475): Launched 16:18:11.916021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:12.164639 run patchelf(pid=23476): Launched 16:18:12.328192 run osmo-stp_10.42.42.5(pid=23473): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23473)] 16:18:12.453196 run osmo-stp_10.42.42.5(pid=23473): stdout: | (launched: 2022-12-10_16:18:11.130838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:12.579579 run osmo-stp_10.42.42.5(pid=23473): stderr: | [0;m[38;5;43m20221210161811301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161811301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161811301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161811302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161811302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161811302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161811302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:12.706579 run osmo-stp_10.42.42.5(pid=23473): stdout: | (launched: 2022-12-10_16:18:11.130838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:12.827843 run osmo-stp_10.42.42.5(pid=23473): stderr: | [0;m[38;5;43m20221210161811301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161811301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161811301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161811302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161811302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161811302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161811302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:12.971296 run patchelf(pid=23476): Terminating (SIGINT) 16:18:13.137126 run patchelf(pid=23476): Terminated: ok {rc=0} 16:18:13.256647 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23473): Process ended prematurely: osmo-stp_10.42.42.5(pid=23473) [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23473)] [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 16:18:13.265843 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 16:18:13.293437 run osmo-hlr_10.42.42.2(pid=23470): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23470)] 16:18:13.341782 run osmo-hlr_10.42.42.2(pid=23470): stdout: | (launched: 2022-12-10_16:18:10.209643) 16:18:13.391782 run osmo-hlr_10.42.42.2(pid=23470): stderr: | [0;m[1;31m20221210161810384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161810384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161810384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161810384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161810384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161810384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161810396 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161810405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161810405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161810405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:13.442315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23469): Terminating (SIGTERM) 16:18:13.482794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23472): Terminating (SIGTERM) 16:18:13.523417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23475): Terminating (SIGTERM) 16:18:13.564257 --- ParallelTerminationStrategy: PID 23469 died... 16:18:13.583651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23469): Terminated: ok {rc=0} 16:18:13.628886 --- ParallelTerminationStrategy: PID 23472 died... 16:18:13.647934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23472): Terminated: ok {rc=0} 16:18:13.693140 --- ParallelTerminationStrategy: PID 23475 died... 16:18:13.712118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23475): Terminated: ok {rc=0} 16:18:13.797921 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:18:15.104207 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:18:15.111124 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:18:15.143921 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:18:15.182136 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:18:15.267465 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:18:15.299595 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:18:15.337822 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:18:15.944176 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:18:15.995367 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:16.007176 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:18:16.084233 tst cs_paging_gprs_active.py: using LAC 29149 16:18:16.211798 tst cs_paging_gprs_active.py: using RAC 79 16:18:16.348587 tst cs_paging_gprs_active.py: using CellId 29149 16:18:16.467634 tst cs_paging_gprs_active.py: using BVCI 29150 16:18:16.588335 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:16.600369 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:16.612296 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:16.624680 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:16.637272 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:16.649470 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:16.662890 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:16.675366 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:16.687921 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:16.813646 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:16.964194 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:18:17.174090 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:17.478266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23481): Launched 16:18:17.740180 run iperf3-srv_10.42.42.10(pid=23482): Launched 16:18:17.851946 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:18:18.052813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:18.352499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23483): Launched 16:18:18.612248 run iperf3-srv_10.42.42.10(pid=23484): Launched 16:18:18.724659 tst cs_paging_gprs_active.py:38: start network... 16:18:18.925443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:19.386191 run create_hlr_db(pid=23485): Launched 16:18:19.499091 bus /gobi_6: Setting Powered False 16:18:20.559000 run create_hlr_db(pid=23485): Terminated: ok {rc=0} 16:18:20.996865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23487): Launched 16:18:21.316201 run osmo-hlr_10.42.42.2(pid=23488): Launched 16:18:21.437851 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:21.990196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23490): Launched 16:18:22.309009 run osmo-stp_10.42.42.5(pid=23491): Launched 16:18:22.430214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:22.982149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23493): Launched 16:18:23.104512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:23.381211 run patchelf(pid=23494): Launched 16:18:23.561294 run osmo-stp_10.42.42.5(pid=23491): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23491)] 16:18:23.697432 run osmo-stp_10.42.42.5(pid=23491): stdout: | (launched: 2022-12-10_16:18:22.250904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:23.835854 run osmo-stp_10.42.42.5(pid=23491): stderr: | [0;m[38;5;43m20221210161822440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161822440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161822440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161822441 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161822441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161822441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161822441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:23.974283 run osmo-stp_10.42.42.5(pid=23491): stdout: | (launched: 2022-12-10_16:18:22.250904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:24.106338 run osmo-stp_10.42.42.5(pid=23491): stderr: | [0;m[38;5;43m20221210161822440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161822440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161822440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161822441 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161822441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161822441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161822441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:24.262398 run patchelf(pid=23494): Terminating (SIGINT) 16:18:24.442352 run patchelf(pid=23494): Terminated: ok {rc=0} 16:18:24.572567 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23491): Process ended prematurely: osmo-stp_10.42.42.5(pid=23491) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23491)] [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:18:24.582725 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:18:24.611400 run osmo-hlr_10.42.42.2(pid=23488): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23488)] 16:18:24.661350 run osmo-hlr_10.42.42.2(pid=23488): stdout: | (launched: 2022-12-10_16:18:21.258234) 16:18:24.713706 run osmo-hlr_10.42.42.2(pid=23488): stderr: | [0;m[1;31m20221210161821455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161821455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161821455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161821455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161821455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161821455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161821468 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161821476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161821476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161821477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:24.766330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23481): Terminating (SIGTERM) 16:18:24.808606 run iperf3-srv_10.42.42.10(pid=23482): Terminating (SIGTERM) 16:18:24.851213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23483): Terminating (SIGTERM) 16:18:24.893560 run iperf3-srv_10.42.42.10(pid=23484): Terminating (SIGTERM) 16:18:24.935631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23487): Terminating (SIGTERM) 16:18:24.977747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23490): Terminating (SIGTERM) 16:18:25.020169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23493): Terminating (SIGTERM) 16:18:25.062913 --- ParallelTerminationStrategy: PID 23481 died... 16:18:25.083178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23481): Terminated: ok {rc=0} 16:18:25.130301 --- ParallelTerminationStrategy: PID 23482 died... 16:18:25.150069 run iperf3-srv_10.42.42.10(pid=23482): Terminated {rc=256} 16:18:25.196721 --- ParallelTerminationStrategy: PID 23483 died... 16:18:25.216607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23483): Terminated: ok {rc=0} 16:18:25.263262 --- ParallelTerminationStrategy: PID 23484 died... 16:18:25.282960 run iperf3-srv_10.42.42.10(pid=23484): Terminated {rc=256} 16:18:25.329715 --- ParallelTerminationStrategy: PID 23487 died... 16:18:25.349618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23487): Terminated: ok {rc=0} 16:18:25.396477 --- ParallelTerminationStrategy: PID 23490 died... 16:18:25.416257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23490): Terminated: ok {rc=0} 16:18:25.462918 --- ParallelTerminationStrategy: PID 23493 died... 16:18:25.482792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23493): Terminated: ok {rc=0} 16:18:25.571528 bus /gobi_0: Setting Powered False 16:18:26.671343 bus /gobi_0: Setting Powered False 16:18:27.788307 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:18:28.938682 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:28.950731 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:18:29.021719 tst iperf3.py: using LAC 29150 16:18:29.144824 tst iperf3.py: using RAC 80 16:18:29.262278 tst iperf3.py: using CellId 29150 16:18:29.379893 tst iperf3.py: using BVCI 29151 16:18:29.498096 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:29.509668 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:29.521098 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:29.532761 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:29.544212 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:29.555760 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:29.567412 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:29.578853 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:29.590759 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:29.704737 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:18:29.906331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:30.206703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23495): Launched 16:18:30.466329 run iperf3-srv_10.42.42.10(pid=23496): Launched 16:18:30.577757 tst iperf3.py:8: start network... 16:18:30.777774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:31.297586 run create_hlr_db(pid=23497): Launched 16:18:31.487168 bus /gobi_6: Setting Powered False 16:18:32.546648 run create_hlr_db(pid=23497): Terminated: ok {rc=0} 16:18:32.993434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23499): Launched 16:18:33.313576 run osmo-hlr_10.42.42.2(pid=23500): Launched 16:18:33.435257 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:34.078617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23502): Launched 16:18:34.389638 run osmo-stp_10.42.42.5(pid=23503): Launched 16:18:34.508312 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:35.048583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23505): Launched 16:18:35.168416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:35.431702 run patchelf(pid=23506): Launched 16:18:35.604650 run osmo-stp_10.42.42.5(pid=23503): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23503)] 16:18:35.737340 run osmo-stp_10.42.42.5(pid=23503): stdout: | (launched: 2022-12-10_16:18:34.333094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:35.872166 run osmo-stp_10.42.42.5(pid=23503): stderr: | [0;m[38;5;43m20221210161834521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161834521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161834521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161834522 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161834522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161834522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161834522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:36.006782 run osmo-stp_10.42.42.5(pid=23503): stdout: | (launched: 2022-12-10_16:18:34.333094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:36.135334 run osmo-stp_10.42.42.5(pid=23503): stderr: | [0;m[38;5;43m20221210161834521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161834521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161834521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161834522 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161834522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161834522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161834522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:36.287348 run patchelf(pid=23506): Terminating (SIGINT) 16:18:36.462390 run patchelf(pid=23506): Terminated: ok {rc=0} 16:18:36.589083 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23503): Process ended prematurely: osmo-stp_10.42.42.5(pid=23503) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23503)] [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 16:18:36.599235 tst iperf3.py:8: Test FAILED (7.7 sec) 16:18:36.628262 run osmo-hlr_10.42.42.2(pid=23500): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23500)] 16:18:36.678193 run osmo-hlr_10.42.42.2(pid=23500): stdout: | (launched: 2022-12-10_16:18:33.255349) 16:18:36.729781 run osmo-hlr_10.42.42.2(pid=23500): stderr: | [0;m[1;31m20221210161833453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161833453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161833453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161833453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161833453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161833454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161833467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161833475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161833476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161833476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:36.782132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23495): Terminating (SIGTERM) 16:18:36.824178 run iperf3-srv_10.42.42.10(pid=23496): Terminating (SIGTERM) 16:18:36.866292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23499): Terminating (SIGTERM) 16:18:36.908372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23502): Terminating (SIGTERM) 16:18:36.950231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23505): Terminating (SIGTERM) 16:18:36.992221 --- ParallelTerminationStrategy: PID 23495 died... 16:18:37.011967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23495): Terminated: ok {rc=0} 16:18:37.059361 --- ParallelTerminationStrategy: PID 23496 died... 16:18:37.078962 run iperf3-srv_10.42.42.10(pid=23496): Terminated {rc=256} 16:18:37.126164 --- ParallelTerminationStrategy: PID 23499 died... 16:18:37.145824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23499): Terminated: ok {rc=0} 16:18:37.192904 --- ParallelTerminationStrategy: PID 23502 died... 16:18:37.212777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23502): Terminated: ok {rc=0} 16:18:37.260098 --- ParallelTerminationStrategy: PID 23505 died... 16:18:37.279576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23505): Terminated: ok {rc=0} 16:18:37.368051 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:18:38.518711 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:38.530690 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:18:38.599519 tst iperf3m4.py: using LAC 29151 16:18:38.724170 tst iperf3m4.py: using RAC 81 16:18:38.846348 tst iperf3m4.py: using CellId 29151 16:18:38.968384 tst iperf3m4.py: using BVCI 29152 16:18:39.081861 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:39.093048 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:39.104010 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:39.115073 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:39.126085 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:39.137096 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:39.148166 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:39.159108 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:39.170324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:39.285452 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:39.403313 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:39.516881 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:39.629463 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:18:39.825674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:40.119560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23507): Launched 16:18:40.374005 run iperf3-srv_10.42.42.10(pid=23508): Launched 16:18:40.483490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:18:40.678730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:40.973009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23509): Launched 16:18:41.226975 run iperf3-srv_10.42.42.10(pid=23510): Launched 16:18:41.335795 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:18:41.530400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:41.824055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23511): Launched 16:18:42.077622 run iperf3-srv_10.42.42.10(pid=23512): Launched 16:18:42.186940 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:18:42.381766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:42.675432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23513): Launched 16:18:42.929545 run iperf3-srv_10.42.42.10(pid=23514): Launched 16:18:43.038982 tst iperf3m4.py:8: start network... 16:18:43.234238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:43.687888 run create_hlr_db(pid=23515): Launched 16:18:43.801560 bus /gobi_6: Setting Powered False 16:18:44.861414 run create_hlr_db(pid=23515): Terminated: ok {rc=0} 16:18:45.289617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23517): Launched 16:18:45.602712 run osmo-hlr_10.42.42.2(pid=23518): Launched 16:18:45.720505 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:46.277514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23520): Launched 16:18:46.594999 run osmo-stp_10.42.42.5(pid=23521): Launched 16:18:46.839158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:47.483720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23523): Launched 16:18:47.595726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:47.843011 run patchelf(pid=23524): Launched 16:18:48.004878 run osmo-stp_10.42.42.5(pid=23521): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23521)] 16:18:48.129704 run osmo-stp_10.42.42.5(pid=23521): stdout: | (launched: 2022-12-10_16:18:46.533644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:48.255737 run osmo-stp_10.42.42.5(pid=23521): stderr: | [0;m[38;5;43m20221210161846789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161846789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161846789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161846790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161846790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161846790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161846791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:48.381822 run osmo-stp_10.42.42.5(pid=23521): stdout: | (launched: 2022-12-10_16:18:46.533644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:48.502102 run osmo-stp_10.42.42.5(pid=23521): stderr: | [0;m[38;5;43m20221210161846789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161846789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161846789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161846790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161846790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161846790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161846791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:48.644191 run patchelf(pid=23524): Terminating (SIGINT) 16:18:48.808871 run patchelf(pid=23524): Terminated: ok {rc=0} 16:18:48.928257 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23521): Process ended prematurely: osmo-stp_10.42.42.5(pid=23521) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23521)] [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:18:48.937694 tst iperf3m4.py:8: Test FAILED (10.5 sec) 16:18:48.964901 run osmo-hlr_10.42.42.2(pid=23518): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23518)] 16:18:49.013295 run osmo-hlr_10.42.42.2(pid=23518): stdout: | (launched: 2022-12-10_16:18:45.545717) 16:18:49.062720 run osmo-hlr_10.42.42.2(pid=23518): stderr: | [0;m[1;31m20221210161845738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161845738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161845738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161845739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161845739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161845739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161845754 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161845762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161845762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161845762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:49.112829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23507): Terminating (SIGTERM) 16:18:49.153057 run iperf3-srv_10.42.42.10(pid=23508): Terminating (SIGTERM) 16:18:49.193099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23509): Terminating (SIGTERM) 16:18:49.232750 run iperf3-srv_10.42.42.10(pid=23510): Terminating (SIGTERM) 16:18:49.272374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23511): Terminating (SIGTERM) 16:18:49.312065 run iperf3-srv_10.42.42.10(pid=23512): Terminating (SIGTERM) 16:18:49.351930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23513): Terminating (SIGTERM) 16:18:49.391685 run iperf3-srv_10.42.42.10(pid=23514): Terminating (SIGTERM) 16:18:49.431325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23517): Terminating (SIGTERM) 16:18:49.471078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23520): Terminating (SIGTERM) 16:18:49.510717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23523): Terminating (SIGTERM) 16:18:49.550826 --- ParallelTerminationStrategy: PID 23507 died... 16:18:49.569784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23507): Terminated: ok {rc=0} 16:18:49.613949 --- ParallelTerminationStrategy: PID 23508 died... 16:18:49.632252 run iperf3-srv_10.42.42.10(pid=23508): Terminated {rc=256} 16:18:49.676733 --- ParallelTerminationStrategy: PID 23509 died... 16:18:49.695078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23509): Terminated: ok {rc=0} 16:18:49.738865 --- ParallelTerminationStrategy: PID 23510 died... 16:18:49.757098 run iperf3-srv_10.42.42.10(pid=23510): Terminated {rc=256} 16:18:49.801256 --- ParallelTerminationStrategy: PID 23511 died... 16:18:49.819571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23511): Terminated: ok {rc=0} 16:18:49.863682 --- ParallelTerminationStrategy: PID 23512 died... 16:18:49.882129 run iperf3-srv_10.42.42.10(pid=23512): Terminated {rc=256} 16:18:49.925947 --- ParallelTerminationStrategy: PID 23513 died... 16:18:49.944294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23513): Terminated: ok {rc=0} 16:18:49.988103 --- ParallelTerminationStrategy: PID 23514 died... 16:18:50.006430 run iperf3-srv_10.42.42.10(pid=23514): Terminated {rc=256} 16:18:50.050156 --- ParallelTerminationStrategy: PID 23517 died... 16:18:50.068505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23517): Terminated: ok {rc=0} 16:18:50.112381 --- ParallelTerminationStrategy: PID 23520 died... 16:18:50.130840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23520): Terminated: ok {rc=0} 16:18:50.174757 --- ParallelTerminationStrategy: PID 23523 died... 16:18:50.193212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23523): Terminated: ok {rc=0} 16:18:50.279567 bus /gobi_4: Setting Powered False 16:18:51.379156 bus /gobi_4: Setting Powered False 16:18:52.494721 bus /gobi_1: Setting Powered False 16:18:53.594941 bus /gobi_1: Setting Powered False 16:18:54.710702 bus /gobi_0: Setting Powered False 16:18:55.806293 bus /gobi_0: Setting Powered False 16:18:56.922468 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:18:58.024455 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:58.035892 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:18:58.104568 tst ping.py: using LAC 29152 16:18:58.219804 tst ping.py: using RAC 82 16:18:58.342005 tst ping.py: using CellId 29152 16:18:58.462208 tst ping.py: using BVCI 29153 16:18:58.573870 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:58.585398 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:58.596598 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:58.608043 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:58.619350 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:58.630808 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:58.642127 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:58.653377 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:58.767230 tst ping.py:19: start network... 16:18:58.975921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:59.454571 run create_hlr_db(pid=23525): Launched 16:18:59.571149 bus /gobi_6: Setting Powered False 16:19:00.632490 run create_hlr_db(pid=23525): Terminated: ok {rc=0} 16:19:01.068798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23527): Launched 16:19:01.387321 run osmo-hlr_10.42.42.2(pid=23528): Launched 16:19:01.626130 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:02.260449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23530): Launched 16:19:02.553149 run osmo-stp_10.42.42.5(pid=23531): Launched 16:19:02.664863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:03.164824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23533): Launched 16:19:03.274616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:03.516912 run patchelf(pid=23534): Launched 16:19:03.676233 run osmo-stp_10.42.42.5(pid=23531): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23531)] 16:19:03.798144 run osmo-stp_10.42.42.5(pid=23531): stdout: | (launched: 2022-12-10_16:19:02.499852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:03.922171 run osmo-stp_10.42.42.5(pid=23531): stderr: | [0;m[38;5;43m20221210161902668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161902668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161902668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161902669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161902669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161902669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161902669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:04.046318 run osmo-stp_10.42.42.5(pid=23531): stdout: | (launched: 2022-12-10_16:19:02.499852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:04.165197 run osmo-stp_10.42.42.5(pid=23531): stderr: | [0;m[38;5;43m20221210161902668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161902668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161902668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161902669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161902669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161902669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161902669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:04.305242 run patchelf(pid=23534): Terminating (SIGINT) 16:19:04.467206 run patchelf(pid=23534): Terminated: ok {rc=0} 16:19:04.583821 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23531): Process ended prematurely: osmo-stp_10.42.42.5(pid=23531) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23531)] [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 16:19:04.592634 tst ping.py:22: Test FAILED (6.6 sec) 16:19:04.619610 run osmo-hlr_10.42.42.2(pid=23528): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23528)] 16:19:04.667543 run osmo-hlr_10.42.42.2(pid=23528): stdout: | (launched: 2022-12-10_16:19:01.318931) 16:19:04.717443 run osmo-hlr_10.42.42.2(pid=23528): stderr: | [0;m[1;31m20221210161901618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161901618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161901618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161901618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161901618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161901618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161901636 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161901658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161901659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161901659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:04.767383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23527): Terminating (SIGTERM) 16:19:04.807101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23530): Terminating (SIGTERM) 16:19:04.846890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23533): Terminating (SIGTERM) 16:19:04.886815 --- ParallelTerminationStrategy: PID 23527 died... 16:19:04.905710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23527): Terminated: ok {rc=0} 16:19:04.949842 --- ParallelTerminationStrategy: PID 23530 died... 16:19:04.968203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23530): Terminated: ok {rc=0} 16:19:05.012389 --- ParallelTerminationStrategy: PID 23533 died... 16:19:05.031057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23533): Terminated: ok {rc=0} 16:19:05.116668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:19:06.205337 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:06.217234 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:19:06.290011 tst ping_idle_ping.py: using LAC 29153 16:19:06.407848 tst ping_idle_ping.py: using RAC 83 16:19:06.528743 tst ping_idle_ping.py: using CellId 29153 16:19:06.648033 tst ping_idle_ping.py: using BVCI 29154 16:19:06.759935 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:06.771377 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:06.782602 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:06.794296 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:06.806109 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:06.817640 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:06.829230 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:06.840721 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:19:06.957779 tst ping_idle_ping.py:24: start network... 16:19:07.153934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:07.603597 run create_hlr_db(pid=23535): Launched 16:19:07.714575 bus /gobi_6: Setting Powered False 16:19:08.772921 run create_hlr_db(pid=23535): Terminated: ok {rc=0} 16:19:09.177689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23537): Launched 16:19:09.466507 run osmo-hlr_10.42.42.2(pid=23538): Launched 16:19:09.576594 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:10.083246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23540): Launched 16:19:10.372254 run osmo-stp_10.42.42.5(pid=23541): Launched 16:19:10.482628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:10.980492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23543): Launched 16:19:11.091440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:11.335179 run patchelf(pid=23544): Launched 16:19:11.495803 run osmo-stp_10.42.42.5(pid=23541): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23541)] 16:19:11.618793 run osmo-stp_10.42.42.5(pid=23541): stdout: | (launched: 2022-12-10_16:19:10.319373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:11.743202 run osmo-stp_10.42.42.5(pid=23541): stderr: | [0;m[38;5;43m20221210161910490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161910490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161910490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161910491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161910491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161910491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161910491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:11.867800 run osmo-stp_10.42.42.5(pid=23541): stdout: | (launched: 2022-12-10_16:19:10.319373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:11.987824 run osmo-stp_10.42.42.5(pid=23541): stderr: | [0;m[38;5;43m20221210161910490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161910490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161910490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161910491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161910491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161910491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161910491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:12.128687 run patchelf(pid=23544): Terminating (SIGINT) 16:19:12.292022 run patchelf(pid=23544): Terminated: ok {rc=0} 16:19:12.410480 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23541): Process ended prematurely: osmo-stp_10.42.42.5(pid=23541) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23541)] [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:19:12.419385 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 16:19:12.446405 run osmo-hlr_10.42.42.2(pid=23538): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23538)] 16:19:12.493805 run osmo-hlr_10.42.42.2(pid=23538): stdout: | (launched: 2022-12-10_16:19:09.413741) 16:19:12.542758 run osmo-hlr_10.42.42.2(pid=23538): stderr: | [0;m[1;31m20221210161909590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161909590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161909590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161909590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161909590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161909590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161909601 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161909612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161909612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161909612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:12.591895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23537): Terminating (SIGTERM) 16:19:12.631623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23540): Terminating (SIGTERM) 16:19:12.671089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23543): Terminating (SIGTERM) 16:19:12.710710 --- ParallelTerminationStrategy: PID 23537 died... 16:19:12.729655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23537): Terminated: ok {rc=0} 16:19:12.774154 --- ParallelTerminationStrategy: PID 23540 died... 16:19:12.792460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23540): Terminated: ok {rc=0} 16:19:12.837269 --- ParallelTerminationStrategy: PID 23543 died... 16:19:12.855632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23543): Terminated: ok {rc=0} 16:19:12.938680 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:19:14.247236 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:19:14.253827 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:19:14.287594 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:19:14.327487 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:19:14.416079 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:19:14.449303 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:19:14.488739 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:19:15.085924 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:19:15.137588 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:15.149058 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:19:15.219518 tst cs_paging_gprs_active.py: using LAC 29154 16:19:15.342737 tst cs_paging_gprs_active.py: using RAC 84 16:19:15.465664 tst cs_paging_gprs_active.py: using CellId 29154 16:19:15.590467 tst cs_paging_gprs_active.py: using BVCI 29155 16:19:15.706138 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:15.717736 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:15.729106 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:15.740767 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:15.752274 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:15.763907 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:15.775568 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:15.787203 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:15.798948 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:15.957229 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:16.082893 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:19:16.342012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:16.659970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23548): Launched 16:19:16.953850 run iperf3-srv_10.42.42.10(pid=23549): Launched 16:19:17.071912 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:19:17.278261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:17.577026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23550): Launched 16:19:17.834600 run iperf3-srv_10.42.42.10(pid=23551): Launched 16:19:17.944500 tst cs_paging_gprs_active.py:38: start network... 16:19:18.142522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:18.598315 run create_hlr_db(pid=23552): Launched 16:19:18.711186 bus /gobi_6: Setting Powered False 16:19:19.770835 run create_hlr_db(pid=23552): Terminated: ok {rc=0} 16:19:20.202381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23554): Launched 16:19:20.515794 run osmo-hlr_10.42.42.2(pid=23555): Launched 16:19:20.636228 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:21.176687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23557): Launched 16:19:21.489052 run osmo-stp_10.42.42.5(pid=23558): Launched 16:19:21.608694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:22.150468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23560): Launched 16:19:22.270541 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:22.536755 run patchelf(pid=23561): Launched 16:19:22.711386 run osmo-stp_10.42.42.5(pid=23558): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23558)] 16:19:22.844601 run osmo-stp_10.42.42.5(pid=23558): stdout: | (launched: 2022-12-10_16:19:21.432393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:22.980438 run osmo-stp_10.42.42.5(pid=23558): stderr: | [0;m[38;5;43m20221210161921619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161921619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161921620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161921620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161921621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161921621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161921621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:23.116178 run osmo-stp_10.42.42.5(pid=23558): stdout: | (launched: 2022-12-10_16:19:21.432393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:23.246177 run osmo-stp_10.42.42.5(pid=23558): stderr: | [0;m[38;5;43m20221210161921619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161921619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161921620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161921620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161921621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161921621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161921621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:23.399148 run patchelf(pid=23561): Terminating (SIGINT) 16:19:23.575728 run patchelf(pid=23561): Terminated: ok {rc=0} 16:19:23.703413 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23558): Process ended prematurely: osmo-stp_10.42.42.5(pid=23558) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23558)] [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:19:23.713496 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:19:23.741754 run osmo-hlr_10.42.42.2(pid=23555): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23555)] 16:19:23.791223 run osmo-hlr_10.42.42.2(pid=23555): stdout: | (launched: 2022-12-10_16:19:20.459107) 16:19:23.842835 run osmo-hlr_10.42.42.2(pid=23555): stderr: | [0;m[1;31m20221210161920654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161920654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161920654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161920654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161920654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161920654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161920667 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161920675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161920675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161920675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:23.894857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23548): Terminating (SIGTERM) 16:19:23.936494 run iperf3-srv_10.42.42.10(pid=23549): Terminating (SIGTERM) 16:19:23.978318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23550): Terminating (SIGTERM) 16:19:24.020121 run iperf3-srv_10.42.42.10(pid=23551): Terminating (SIGTERM) 16:19:24.061810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23554): Terminating (SIGTERM) 16:19:24.103705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23557): Terminating (SIGTERM) 16:19:24.145366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23560): Terminating (SIGTERM) 16:19:24.187165 --- ParallelTerminationStrategy: PID 23548 died... 16:19:24.207059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23548): Terminated: ok {rc=0} 16:19:24.253288 --- ParallelTerminationStrategy: PID 23549 died... 16:19:24.272606 run iperf3-srv_10.42.42.10(pid=23549): Terminated {rc=256} 16:19:24.318562 --- ParallelTerminationStrategy: PID 23550 died... 16:19:24.338023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23550): Terminated: ok {rc=0} 16:19:24.384043 --- ParallelTerminationStrategy: PID 23551 died... 16:19:24.403457 run iperf3-srv_10.42.42.10(pid=23551): Terminated {rc=256} 16:19:24.449398 --- ParallelTerminationStrategy: PID 23554 died... 16:19:24.468928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23554): Terminated: ok {rc=0} 16:19:24.515156 --- ParallelTerminationStrategy: PID 23557 died... 16:19:24.534677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23557): Terminated: ok {rc=0} 16:19:24.580566 --- ParallelTerminationStrategy: PID 23560 died... 16:19:24.600173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23560): Terminated: ok {rc=0} 16:19:24.687665 bus /gobi_0: Setting Powered False 16:19:25.787217 bus /gobi_0: Setting Powered False 16:19:26.902455 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:19:28.050701 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.062878 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:19:28.135213 tst iperf3.py: using LAC 29155 16:19:28.259297 tst iperf3.py: using RAC 85 16:19:28.385514 tst iperf3.py: using CellId 29155 16:19:28.501686 tst iperf3.py: using BVCI 29156 16:19:28.617785 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.629374 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.640644 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.652175 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.663642 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.675189 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.686887 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.698112 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.709556 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:28.822197 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:19:29.019931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:29.314753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23562): Launched 16:19:29.570915 run iperf3-srv_10.42.42.10(pid=23563): Launched 16:19:29.681983 tst iperf3.py:8: start network... 16:19:29.878145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:30.333011 run create_hlr_db(pid=23564): Launched 16:19:30.446054 bus /gobi_6: Setting Powered False 16:19:31.528602 run create_hlr_db(pid=23564): Terminated: ok {rc=0} 16:19:31.997734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23566): Launched 16:19:32.327677 run osmo-hlr_10.42.42.2(pid=23567): Launched 16:19:32.447889 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:32.989107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23569): Launched 16:19:33.301890 run osmo-stp_10.42.42.5(pid=23570): Launched 16:19:33.420600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:33.960901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23572): Launched 16:19:34.080653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:34.345068 run patchelf(pid=23573): Launched 16:19:34.518631 run osmo-stp_10.42.42.5(pid=23570): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23570)] 16:19:34.651565 run osmo-stp_10.42.42.5(pid=23570): stdout: | (launched: 2022-12-10_16:19:33.244769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:34.786481 run osmo-stp_10.42.42.5(pid=23570): stderr: | [0;m[38;5;43m20221210161933434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161933434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161933434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161933435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161933435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161933435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161933435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:34.921829 run osmo-stp_10.42.42.5(pid=23570): stdout: | (launched: 2022-12-10_16:19:33.244769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:35.050335 run osmo-stp_10.42.42.5(pid=23570): stderr: | [0;m[38;5;43m20221210161933434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161933434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161933434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161933435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161933435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161933435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161933435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:35.203136 run patchelf(pid=23573): Terminating (SIGINT) 16:19:35.380168 run patchelf(pid=23573): Terminated: ok {rc=0} 16:19:35.507462 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23570): Process ended prematurely: osmo-stp_10.42.42.5(pid=23570) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23570)] [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 16:19:35.517468 tst iperf3.py:8: Test FAILED (7.5 sec) 16:19:35.545904 run osmo-hlr_10.42.42.2(pid=23567): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23567)] 16:19:35.595981 run osmo-hlr_10.42.42.2(pid=23567): stdout: | (launched: 2022-12-10_16:19:32.270764) 16:19:35.647652 run osmo-hlr_10.42.42.2(pid=23567): stderr: | [0;m[1;31m20221210161932467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161932467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161932467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161932467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161932467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161932467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161932479 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161932488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161932488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161932488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:35.700032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23562): Terminating (SIGTERM) 16:19:35.741688 run iperf3-srv_10.42.42.10(pid=23563): Terminating (SIGTERM) 16:19:35.783112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23566): Terminating (SIGTERM) 16:19:35.824686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23569): Terminating (SIGTERM) 16:19:35.866836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23572): Terminating (SIGTERM) 16:19:35.909237 --- ParallelTerminationStrategy: PID 23562 died... 16:19:35.929301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23562): Terminated: ok {rc=0} 16:19:35.976162 --- ParallelTerminationStrategy: PID 23563 died... 16:19:35.995831 run iperf3-srv_10.42.42.10(pid=23563): Terminated {rc=256} 16:19:36.042425 --- ParallelTerminationStrategy: PID 23566 died... 16:19:36.062108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23566): Terminated: ok {rc=0} 16:19:36.108690 --- ParallelTerminationStrategy: PID 23569 died... 16:19:36.128356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23569): Terminated: ok {rc=0} 16:19:36.174914 --- ParallelTerminationStrategy: PID 23572 died... 16:19:36.194657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23572): Terminated: ok {rc=0} 16:19:36.283051 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:19:37.431463 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:37.443500 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:19:37.528423 tst iperf3m4.py: using LAC 29156 16:19:37.650921 tst iperf3m4.py: using RAC 86 16:19:37.770018 tst iperf3m4.py: using CellId 29156 16:19:37.886093 tst iperf3m4.py: using BVCI 29157 16:19:37.993487 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:38.004503 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:38.015351 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:38.026390 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:38.037489 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:38.048485 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:38.059709 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:38.070694 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:38.081883 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:38.199788 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:38.315680 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:38.431616 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:38.546109 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:19:38.744343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:39.040634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23574): Launched 16:19:39.296557 run iperf3-srv_10.42.42.10(pid=23575): Launched 16:19:39.406137 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:19:39.602553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:39.897093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23576): Launched 16:19:40.152879 run iperf3-srv_10.42.42.10(pid=23577): Launched 16:19:40.263236 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:19:40.459779 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:40.754539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23578): Launched 16:19:41.009462 run iperf3-srv_10.42.42.10(pid=23579): Launched 16:19:41.119645 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:19:41.316756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:41.612467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23580): Launched 16:19:41.868193 run iperf3-srv_10.42.42.10(pid=23581): Launched 16:19:41.986223 tst iperf3m4.py:8: start network... 16:19:42.198315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:42.684719 run create_hlr_db(pid=23582): Launched 16:19:42.811939 bus /gobi_6: Setting Powered False 16:19:43.875670 run create_hlr_db(pid=23582): Terminated: ok {rc=0} 16:19:44.297624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23584): Launched 16:19:44.593710 run osmo-hlr_10.42.42.2(pid=23585): Launched 16:19:44.706222 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:45.225700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23587): Launched 16:19:45.542089 run osmo-stp_10.42.42.5(pid=23588): Launched 16:19:45.660569 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:46.233660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23590): Launched 16:19:46.359577 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:46.630811 run patchelf(pid=23591): Launched 16:19:46.819281 run osmo-stp_10.42.42.5(pid=23588): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23588)] 16:19:46.956485 run osmo-stp_10.42.42.5(pid=23588): stdout: | (launched: 2022-12-10_16:19:45.485144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:47.094210 run osmo-stp_10.42.42.5(pid=23588): stderr: | [0;m[38;5;43m20221210161945672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161945672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161945673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161945673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:47.231202 run osmo-stp_10.42.42.5(pid=23588): stdout: | (launched: 2022-12-10_16:19:45.485144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:47.361318 run osmo-stp_10.42.42.5(pid=23588): stderr: | [0;m[38;5;43m20221210161945672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210161945672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210161945673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210161945673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210161945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210161945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210161945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:47.515154 run patchelf(pid=23591): Terminating (SIGINT) 16:19:47.693269 run patchelf(pid=23591): Terminated: ok {rc=0} 16:19:47.821842 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23588): Process ended prematurely: osmo-stp_10.42.42.5(pid=23588) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23588)] [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:19:47.832173 tst iperf3m4.py:8: Test FAILED (10.4 sec) 16:19:47.861419 run osmo-hlr_10.42.42.2(pid=23585): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23585)] 16:19:47.911894 run osmo-hlr_10.42.42.2(pid=23585): stdout: | (launched: 2022-12-10_16:19:44.539445) 16:19:47.964028 run osmo-hlr_10.42.42.2(pid=23585): stderr: | [0;m[1;31m20221210161944711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210161944711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210161944711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210161944711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210161944712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210161944712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210161944724 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210161944733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210161944733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210161944733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:48.016637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23574): Terminating (SIGTERM) 16:19:48.058787 run iperf3-srv_10.42.42.10(pid=23575): Terminating (SIGTERM) 16:19:48.100822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23576): Terminating (SIGTERM) 16:19:48.142896 run iperf3-srv_10.42.42.10(pid=23577): Terminating (SIGTERM) 16:19:48.184743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23578): Terminating (SIGTERM) 16:19:48.227007 run iperf3-srv_10.42.42.10(pid=23579): Terminating (SIGTERM) 16:19:48.268853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23580): Terminating (SIGTERM) 16:19:48.311029 run iperf3-srv_10.42.42.10(pid=23581): Terminating (SIGTERM) 16:19:48.352932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23584): Terminating (SIGTERM) 16:19:48.394990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23587): Terminating (SIGTERM) 16:19:48.437013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23590): Terminating (SIGTERM) 16:19:48.479466 --- ParallelTerminationStrategy: PID 23574 died... 16:19:48.499561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23574): Terminated: ok {rc=0} 16:19:48.546314 --- ParallelTerminationStrategy: PID 23575 died... 16:19:48.565951 run iperf3-srv_10.42.42.10(pid=23575): Terminated {rc=256} 16:19:48.612591 --- ParallelTerminationStrategy: PID 23576 died... 16:19:48.632321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23576): Terminated: ok {rc=0} 16:19:48.678651 --- ParallelTerminationStrategy: PID 23577 died... 16:19:48.698340 run iperf3-srv_10.42.42.10(pid=23577): Terminated {rc=256} 16:19:48.744837 --- ParallelTerminationStrategy: PID 23578 died... 16:19:48.764850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23578): Terminated: ok {rc=0} 16:19:48.811262 --- ParallelTerminationStrategy: PID 23579 died... 16:19:48.830802 run iperf3-srv_10.42.42.10(pid=23579): Terminated {rc=256} 16:19:48.877462 --- ParallelTerminationStrategy: PID 23580 died... 16:19:48.897090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23580): Terminated: ok {rc=0} 16:19:48.943680 --- ParallelTerminationStrategy: PID 23581 died... 16:19:48.963271 run iperf3-srv_10.42.42.10(pid=23581): Terminated {rc=256} 16:19:49.009696 --- ParallelTerminationStrategy: PID 23584 died... 16:19:49.029304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23584): Terminated: ok {rc=0} 16:19:49.075518 --- ParallelTerminationStrategy: PID 23587 died... 16:19:49.095118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23587): Terminated: ok {rc=0} 16:19:49.141467 --- ParallelTerminationStrategy: PID 23590 died... 16:19:49.161180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23590): Terminated: ok {rc=0} 16:19:49.249523 bus /gobi_4: Setting Powered False 16:19:50.349324 bus /gobi_4: Setting Powered False 16:19:51.465824 bus /gobi_1: Setting Powered False 16:19:52.564137 bus /gobi_1: Setting Powered False 16:19:53.680227 bus /gobi_0: Setting Powered False 16:19:54.779045 bus /gobi_0: Setting Powered False 16:19:55.895588 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:19:56.997462 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:57.009729 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:19:57.082097 tst ping.py: using LAC 29157 16:19:57.204476 tst ping.py: using RAC 87 16:19:57.325391 tst ping.py: using CellId 29157 16:19:57.441681 tst ping.py: using BVCI 29158 16:19:57.556841 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:57.568445 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:57.579902 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:57.591429 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:57.603000 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:57.614645 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:57.626334 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:57.637713 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:57.751145 tst ping.py:19: start network... 16:19:57.946778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:58.400188 run create_hlr_db(pid=23593): Launched 16:19:58.511287 bus /gobi_6: Setting Powered False 16:19:59.570212 run create_hlr_db(pid=23593): Terminated: ok {rc=0} 16:19:59.997891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23595): Launched 16:20:00.308624 run osmo-hlr_10.42.42.2(pid=23596): Launched 16:20:00.427205 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:00.981198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23598): Launched 16:20:01.314222 run osmo-stp_10.42.42.5(pid=23599): Launched 16:20:01.601783 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:02.193882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23604): Launched 16:20:02.320731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:02.583549 run patchelf(pid=23605): Launched 16:20:02.755846 run osmo-stp_10.42.42.5(pid=23599): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23599)] 16:20:02.888386 run osmo-stp_10.42.42.5(pid=23599): stdout: | (launched: 2022-12-10_16:20:01.250110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:03.022027 run osmo-stp_10.42.42.5(pid=23599): stderr: | [0;m[38;5;43m20221210162001467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162001467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162001468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162001468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162001468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162001469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162001469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:03.155663 run osmo-stp_10.42.42.5(pid=23599): stdout: | (launched: 2022-12-10_16:20:01.250110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:03.283411 run osmo-stp_10.42.42.5(pid=23599): stderr: | [0;m[38;5;43m20221210162001467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162001467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162001468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162001468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162001468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162001469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162001469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:03.434764 run patchelf(pid=23605): Terminating (SIGINT) 16:20:03.609571 run patchelf(pid=23605): Terminated: ok {rc=0} 16:20:03.735085 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23599): Process ended prematurely: osmo-stp_10.42.42.5(pid=23599) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23599)] [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 16:20:03.744432 tst ping.py:22: Test FAILED (6.7 sec) 16:20:03.772730 run osmo-hlr_10.42.42.2(pid=23596): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23596)] 16:20:03.822631 run osmo-hlr_10.42.42.2(pid=23596): stdout: | (launched: 2022-12-10_16:20:00.251913) 16:20:03.874595 run osmo-hlr_10.42.42.2(pid=23596): stderr: | [0;m[1;31m20221210162000449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162000449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162000449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162000450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162000450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162000450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162000462 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162000473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162000473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162000473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:03.926825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23595): Terminating (SIGTERM) 16:20:03.968814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23598): Terminating (SIGTERM) 16:20:04.010910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23604): Terminating (SIGTERM) 16:20:04.053377 --- ParallelTerminationStrategy: PID 23595 died... 16:20:04.073497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23595): Terminated: ok {rc=0} 16:20:04.120393 --- ParallelTerminationStrategy: PID 23598 died... 16:20:04.140112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23598): Terminated: ok {rc=0} 16:20:04.186495 --- ParallelTerminationStrategy: PID 23604 died... 16:20:04.206127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23604): Terminated: ok {rc=0} 16:20:04.294114 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:20:05.378643 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:05.390392 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:20:05.463451 tst ping_idle_ping.py: using LAC 29158 16:20:05.581155 tst ping_idle_ping.py: using RAC 88 16:20:05.704322 tst ping_idle_ping.py: using CellId 29158 16:20:05.826642 tst ping_idle_ping.py: using BVCI 29159 16:20:05.943480 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:05.955142 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:05.966658 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:05.978226 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:05.989686 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:06.001353 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:06.012823 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:06.024368 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:20:06.137866 tst ping_idle_ping.py:24: start network... 16:20:06.334265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:06.786560 run create_hlr_db(pid=23607): Launched 16:20:06.897923 bus /gobi_6: Setting Powered False 16:20:07.955960 run create_hlr_db(pid=23607): Terminated: ok {rc=0} 16:20:08.385109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23609): Launched 16:20:08.696447 run osmo-hlr_10.42.42.2(pid=23610): Launched 16:20:08.814748 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:09.351588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23612): Launched 16:20:09.664656 run osmo-stp_10.42.42.5(pid=23613): Launched 16:20:09.783778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:10.322697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23615): Launched 16:20:10.441686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:10.705402 run patchelf(pid=23616): Launched 16:20:10.879094 run osmo-stp_10.42.42.5(pid=23613): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23613)] 16:20:11.012253 run osmo-stp_10.42.42.5(pid=23613): stdout: | (launched: 2022-12-10_16:20:09.607428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:11.146959 run osmo-stp_10.42.42.5(pid=23613): stderr: | [0;m[38;5;43m20221210162009800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162009801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162009801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162009801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162009802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162009802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162009802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:11.281544 run osmo-stp_10.42.42.5(pid=23613): stdout: | (launched: 2022-12-10_16:20:09.607428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:11.410309 run osmo-stp_10.42.42.5(pid=23613): stderr: | [0;m[38;5;43m20221210162009800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162009801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162009801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162009801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162009802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162009802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162009802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:11.563212 run patchelf(pid=23616): Terminating (SIGINT) 16:20:11.739281 run patchelf(pid=23616): Terminated: ok {rc=0} 16:20:11.865719 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23613): Process ended prematurely: osmo-stp_10.42.42.5(pid=23613) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23613)] [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:20:11.875474 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:20:11.904042 run osmo-hlr_10.42.42.2(pid=23610): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23610)] 16:20:11.954120 run osmo-hlr_10.42.42.2(pid=23610): stdout: | (launched: 2022-12-10_16:20:08.639511) 16:20:12.005719 run osmo-hlr_10.42.42.2(pid=23610): stderr: | [0;m[1;31m20221210162008838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162008838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162008838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162008838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162008838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162008839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162008851 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162008859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162008859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162008859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:12.057979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23609): Terminating (SIGTERM) 16:20:12.099788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23612): Terminating (SIGTERM) 16:20:12.141544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23615): Terminating (SIGTERM) 16:20:12.183491 --- ParallelTerminationStrategy: PID 23609 died... 16:20:12.203478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23609): Terminated: ok {rc=0} 16:20:12.250029 --- ParallelTerminationStrategy: PID 23612 died... 16:20:12.269591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23612): Terminated: ok {rc=0} 16:20:12.316311 --- ParallelTerminationStrategy: PID 23615 died... 16:20:12.336332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23615): Terminated: ok {rc=0} 16:20:12.424465 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:20:13.729097 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:20:13.735770 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:20:13.771520 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:20:13.811223 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:20:13.900681 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:20:13.934458 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:20:13.974707 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:20:14.576862 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:20:14.630189 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:14.642224 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:20:14.695475 tst cs_paging_gprs_active.py: using LAC 29159 16:20:14.816040 tst cs_paging_gprs_active.py: using RAC 89 16:20:14.936054 tst cs_paging_gprs_active.py: using CellId 29159 16:20:15.065596 tst cs_paging_gprs_active.py: using BVCI 29160 16:20:15.183144 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:15.195066 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:15.206780 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:15.218719 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:15.230365 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:15.241991 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:15.253802 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:15.265425 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:15.277313 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:15.400671 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:15.516210 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:20:15.717663 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:16.065126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23620): Launched 16:20:16.350797 run iperf3-srv_10.42.42.10(pid=23621): Launched 16:20:16.504433 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:20:16.727121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:17.058326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23622): Launched 16:20:17.330586 run iperf3-srv_10.42.42.10(pid=23623): Launched 16:20:17.442212 tst cs_paging_gprs_active.py:38: start network... 16:20:17.642077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:18.102318 run create_hlr_db(pid=23624): Launched 16:20:18.216090 bus /gobi_6: Setting Powered False 16:20:19.276115 run create_hlr_db(pid=23624): Terminated: ok {rc=0} 16:20:19.712467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23626): Launched 16:20:20.032186 run osmo-hlr_10.42.42.2(pid=23627): Launched 16:20:20.153075 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:20.703061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23629): Launched 16:20:21.020106 run osmo-stp_10.42.42.5(pid=23630): Launched 16:20:21.140283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:21.688015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23632): Launched 16:20:21.809320 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:22.077951 run patchelf(pid=23633): Launched 16:20:22.254593 run osmo-stp_10.42.42.5(pid=23630): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23630)] 16:20:22.388864 run osmo-stp_10.42.42.5(pid=23630): stdout: | (launched: 2022-12-10_16:20:20.962465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:22.525870 run osmo-stp_10.42.42.5(pid=23630): stderr: | [0;m[38;5;43m20221210162021154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162021154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162021154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162021155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162021155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162021155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162021155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:22.662618 run osmo-stp_10.42.42.5(pid=23630): stdout: | (launched: 2022-12-10_16:20:20.962465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:22.792911 run osmo-stp_10.42.42.5(pid=23630): stderr: | [0;m[38;5;43m20221210162021154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162021154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162021154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162021155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162021155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162021155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162021155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:22.947511 run patchelf(pid=23633): Terminating (SIGINT) 16:20:23.125883 run patchelf(pid=23633): Terminated: ok {rc=0} 16:20:23.254519 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23630): Process ended prematurely: osmo-stp_10.42.42.5(pid=23630) [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23630)] [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:20:23.264678 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:20:23.293713 run osmo-hlr_10.42.42.2(pid=23627): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23627)] 16:20:23.344413 run osmo-hlr_10.42.42.2(pid=23627): stdout: | (launched: 2022-12-10_16:20:19.974192) 16:20:23.396242 run osmo-hlr_10.42.42.2(pid=23627): stderr: | [0;m[1;31m20221210162020170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162020170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162020170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162020170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162020171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162020171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162020183 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162020194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162020194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162020194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:23.448793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23620): Terminating (SIGTERM) 16:20:23.490942 run iperf3-srv_10.42.42.10(pid=23621): Terminating (SIGTERM) 16:20:23.532861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23622): Terminating (SIGTERM) 16:20:23.574977 run iperf3-srv_10.42.42.10(pid=23623): Terminating (SIGTERM) 16:20:23.616809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23626): Terminating (SIGTERM) 16:20:23.659610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23629): Terminating (SIGTERM) 16:20:23.701439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23632): Terminating (SIGTERM) 16:20:23.743786 --- ParallelTerminationStrategy: PID 23620 died... 16:20:23.763810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23620): Terminated: ok {rc=0} 16:20:23.810611 --- ParallelTerminationStrategy: PID 23621 died... 16:20:23.830195 run iperf3-srv_10.42.42.10(pid=23621): Terminated {rc=256} 16:20:23.876384 --- ParallelTerminationStrategy: PID 23622 died... 16:20:23.896216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23622): Terminated: ok {rc=0} 16:20:23.942471 --- ParallelTerminationStrategy: PID 23623 died... 16:20:23.961971 run iperf3-srv_10.42.42.10(pid=23623): Terminated {rc=256} 16:20:24.008190 --- ParallelTerminationStrategy: PID 23626 died... 16:20:24.027800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23626): Terminated: ok {rc=0} 16:20:24.074008 --- ParallelTerminationStrategy: PID 23629 died... 16:20:24.093670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23629): Terminated: ok {rc=0} 16:20:24.140115 --- ParallelTerminationStrategy: PID 23632 died... 16:20:24.159770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23632): Terminated: ok {rc=0} 16:20:24.248253 bus /gobi_0: Setting Powered False 16:20:25.348255 bus /gobi_0: Setting Powered False 16:20:26.464045 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:20:27.609390 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:27.621110 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:20:27.676128 tst iperf3.py: using LAC 29160 16:20:27.793162 tst iperf3.py: using RAC 90 16:20:27.910511 tst iperf3.py: using CellId 29160 16:20:28.028128 tst iperf3.py: using BVCI 29161 16:20:28.136073 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.147364 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.158357 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.169738 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.180894 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.192092 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.203386 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.214844 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.226470 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:28.342343 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:20:28.541666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:28.840272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23634): Launched 16:20:29.099775 run iperf3-srv_10.42.42.10(pid=23635): Launched 16:20:29.211122 tst iperf3.py:8: start network... 16:20:29.410149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:29.870324 run create_hlr_db(pid=23636): Launched 16:20:29.982435 bus /gobi_6: Setting Powered False 16:20:31.040076 run create_hlr_db(pid=23636): Terminated: ok {rc=0} 16:20:31.474907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23638): Launched 16:20:31.794975 run osmo-hlr_10.42.42.2(pid=23639): Launched 16:20:32.029271 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:32.697405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23641): Launched 16:20:33.014559 run osmo-stp_10.42.42.5(pid=23642): Launched 16:20:33.134843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:33.680679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23644): Launched 16:20:33.802748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:34.071242 run patchelf(pid=23645): Launched 16:20:34.248136 run osmo-stp_10.42.42.5(pid=23642): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23642)] 16:20:34.382978 run osmo-stp_10.42.42.5(pid=23642): stdout: | (launched: 2022-12-10_16:20:32.956775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:34.519756 run osmo-stp_10.42.42.5(pid=23642): stderr: | [0;m[38;5;43m20221210162033148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162033148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162033148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162033148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162033149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162033149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162033149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:34.656668 run osmo-stp_10.42.42.5(pid=23642): stdout: | (launched: 2022-12-10_16:20:32.956775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:34.786543 run osmo-stp_10.42.42.5(pid=23642): stderr: | [0;m[38;5;43m20221210162033148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162033148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162033148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162033148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162033149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162033149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162033149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:34.941569 run patchelf(pid=23645): Terminating (SIGINT) 16:20:35.119911 run patchelf(pid=23645): Terminated: ok {rc=0} 16:20:35.248472 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23642): Process ended prematurely: osmo-stp_10.42.42.5(pid=23642) [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23642)] [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:20:35.258470 tst iperf3.py:8: Test FAILED (7.7 sec) 16:20:35.287085 run osmo-hlr_10.42.42.2(pid=23639): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23639)] 16:20:35.336758 run osmo-hlr_10.42.42.2(pid=23639): stdout: | (launched: 2022-12-10_16:20:31.726397) 16:20:35.388152 run osmo-hlr_10.42.42.2(pid=23639): stderr: | [0;m[1;31m20221210162032090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162032090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162032090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162032090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162032090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162032091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162032105 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162032130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162032130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162032130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:35.440160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23634): Terminating (SIGTERM) 16:20:35.481957 run iperf3-srv_10.42.42.10(pid=23635): Terminating (SIGTERM) 16:20:35.523703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23638): Terminating (SIGTERM) 16:20:35.565736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23641): Terminating (SIGTERM) 16:20:35.607764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23644): Terminating (SIGTERM) 16:20:35.649939 --- ParallelTerminationStrategy: PID 23634 died... 16:20:35.669871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23634): Terminated: ok {rc=0} 16:20:35.716425 --- ParallelTerminationStrategy: PID 23635 died... 16:20:35.736217 run iperf3-srv_10.42.42.10(pid=23635): Terminated {rc=256} 16:20:35.782513 --- ParallelTerminationStrategy: PID 23638 died... 16:20:35.802100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23638): Terminated: ok {rc=0} 16:20:35.848238 --- ParallelTerminationStrategy: PID 23641 died... 16:20:35.867832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23641): Terminated: ok {rc=0} 16:20:35.914349 --- ParallelTerminationStrategy: PID 23644 died... 16:20:35.934024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23644): Terminated: ok {rc=0} 16:20:36.022166 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:20:37.173251 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:37.185773 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:20:37.239250 tst iperf3m4.py: using LAC 29161 16:20:37.363871 tst iperf3m4.py: using RAC 91 16:20:37.487940 tst iperf3m4.py: using CellId 29161 16:20:37.615007 tst iperf3m4.py: using BVCI 29162 16:20:37.730158 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:37.742238 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:37.754166 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:37.766164 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:37.778110 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:37.789850 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:37.801686 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:37.813379 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:37.825350 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:37.939890 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:38.060407 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:38.175742 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:38.290874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:20:38.490741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:38.789197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23646): Launched 16:20:39.048239 run iperf3-srv_10.42.42.10(pid=23647): Launched 16:20:39.159291 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:20:39.358317 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:39.655551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23648): Launched 16:20:39.913847 run iperf3-srv_10.42.42.10(pid=23649): Launched 16:20:40.025329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:20:40.225006 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:40.523810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23650): Launched 16:20:40.782223 run iperf3-srv_10.42.42.10(pid=23651): Launched 16:20:40.893149 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:20:41.091600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:41.389178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23652): Launched 16:20:41.649437 run iperf3-srv_10.42.42.10(pid=23653): Launched 16:20:41.760535 tst iperf3m4.py:8: start network... 16:20:41.960383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:42.420405 run create_hlr_db(pid=23654): Launched 16:20:42.550246 bus /gobi_6: Setting Powered False 16:20:43.613207 run create_hlr_db(pid=23654): Terminated: ok {rc=0} 16:20:44.038926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23656): Launched 16:20:44.336255 run osmo-hlr_10.42.42.2(pid=23657): Launched 16:20:44.448243 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:44.972863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23659): Launched 16:20:45.269018 run osmo-stp_10.42.42.5(pid=23660): Launched 16:20:45.381615 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:45.918891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23662): Launched 16:20:46.056720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:46.369848 run patchelf(pid=23663): Launched 16:20:46.565210 run osmo-stp_10.42.42.5(pid=23660): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23660)] 16:20:46.703051 run osmo-stp_10.42.42.5(pid=23660): stdout: | (launched: 2022-12-10_16:20:45.214784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:46.843985 run osmo-stp_10.42.42.5(pid=23660): stderr: | [0;m[38;5;43m20221210162045381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162045382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162045382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162045382 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162045383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162045383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162045383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:46.984370 run osmo-stp_10.42.42.5(pid=23660): stdout: | (launched: 2022-12-10_16:20:45.214784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:47.117876 run osmo-stp_10.42.42.5(pid=23660): stderr: | [0;m[38;5;43m20221210162045381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162045382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162045382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162045382 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162045383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162045383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162045383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:47.274040 run patchelf(pid=23663): Terminating (SIGINT) 16:20:47.452267 run patchelf(pid=23663): Terminated: ok {rc=0} 16:20:47.581340 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23660): Process ended prematurely: osmo-stp_10.42.42.5(pid=23660) [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23660)] [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:20:47.591801 tst iperf3m4.py:8: Test FAILED (10.5 sec) 16:20:47.621175 run osmo-hlr_10.42.42.2(pid=23657): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23657)] 16:20:47.671627 run osmo-hlr_10.42.42.2(pid=23657): stdout: | (launched: 2022-12-10_16:20:44.281582) 16:20:47.723897 run osmo-hlr_10.42.42.2(pid=23657): stderr: | [0;m[1;31m20221210162044454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162044454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162044455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162044455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162044455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162044455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162044467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162044478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162044478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162044478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:47.776369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23646): Terminating (SIGTERM) 16:20:47.819221 run iperf3-srv_10.42.42.10(pid=23647): Terminating (SIGTERM) 16:20:47.861798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23648): Terminating (SIGTERM) 16:20:47.904821 run iperf3-srv_10.42.42.10(pid=23649): Terminating (SIGTERM) 16:20:47.947185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23650): Terminating (SIGTERM) 16:20:47.989274 run iperf3-srv_10.42.42.10(pid=23651): Terminating (SIGTERM) 16:20:48.031122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23652): Terminating (SIGTERM) 16:20:48.073335 run iperf3-srv_10.42.42.10(pid=23653): Terminating (SIGTERM) 16:20:48.115154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23656): Terminating (SIGTERM) 16:20:48.157149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23659): Terminating (SIGTERM) 16:20:48.199154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23662): Terminating (SIGTERM) 16:20:48.241471 --- ParallelTerminationStrategy: PID 23646 died... 16:20:48.261236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23646): Terminated: ok {rc=0} 16:20:48.308291 --- ParallelTerminationStrategy: PID 23647 died... 16:20:48.328293 run iperf3-srv_10.42.42.10(pid=23647): Terminated {rc=256} 16:20:48.374757 --- ParallelTerminationStrategy: PID 23648 died... 16:20:48.394569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23648): Terminated: ok {rc=0} 16:20:48.441228 --- ParallelTerminationStrategy: PID 23649 died... 16:20:48.460724 run iperf3-srv_10.42.42.10(pid=23649): Terminated {rc=256} 16:20:48.507177 --- ParallelTerminationStrategy: PID 23650 died... 16:20:48.527035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23650): Terminated: ok {rc=0} 16:20:48.573854 --- ParallelTerminationStrategy: PID 23651 died... 16:20:48.593534 run iperf3-srv_10.42.42.10(pid=23651): Terminated {rc=256} 16:20:48.639999 --- ParallelTerminationStrategy: PID 23652 died... 16:20:48.659753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23652): Terminated: ok {rc=0} 16:20:48.706290 --- ParallelTerminationStrategy: PID 23653 died... 16:20:48.725921 run iperf3-srv_10.42.42.10(pid=23653): Terminated {rc=256} 16:20:48.772257 --- ParallelTerminationStrategy: PID 23656 died... 16:20:48.792144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23656): Terminated: ok {rc=0} 16:20:48.838956 --- ParallelTerminationStrategy: PID 23659 died... 16:20:48.858727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23659): Terminated: ok {rc=0} 16:20:48.905807 --- ParallelTerminationStrategy: PID 23662 died... 16:20:48.925416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23662): Terminated: ok {rc=0} 16:20:49.013394 bus /gobi_4: Setting Powered False 16:20:50.113268 bus /gobi_4: Setting Powered False 16:20:51.230596 bus /gobi_1: Setting Powered False 16:20:52.329664 bus /gobi_1: Setting Powered False 16:20:53.444926 bus /gobi_0: Setting Powered False 16:20:54.543912 bus /gobi_0: Setting Powered False 16:20:55.659944 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:20:56.764058 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:56.778163 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:20:56.831283 tst ping.py: using LAC 29162 16:20:56.953039 tst ping.py: using RAC 92 16:20:57.080371 tst ping.py: using CellId 29162 16:20:57.200917 tst ping.py: using BVCI 29163 16:20:57.313551 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:57.325409 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:57.336869 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:57.348420 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:57.360046 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:57.371577 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:57.383163 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:57.394689 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:57.509550 tst ping.py:19: start network... 16:20:57.704769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:58.153861 run create_hlr_db(pid=23664): Launched 16:20:58.265202 bus /gobi_6: Setting Powered False 16:20:59.324049 run create_hlr_db(pid=23664): Terminated: ok {rc=0} 16:20:59.750375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23666): Launched 16:21:00.061377 run osmo-hlr_10.42.42.2(pid=23667): Launched 16:21:00.179118 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:00.721704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23669): Launched 16:21:01.057684 run osmo-stp_10.42.42.5(pid=23670): Launched 16:21:01.246146 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:01.874596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23672): Launched 16:21:02.014151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:02.271192 run patchelf(pid=23673): Launched 16:21:02.453502 run osmo-stp_10.42.42.5(pid=23670): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23670)] 16:21:02.578559 run osmo-stp_10.42.42.5(pid=23670): stdout: | (launched: 2022-12-10_16:21:00.987751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:02.704523 run osmo-stp_10.42.42.5(pid=23670): stderr: | [0;m[38;5;43m20221210162101328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162101334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162101339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162101345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162101345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162101345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162101345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:02.831088 run osmo-stp_10.42.42.5(pid=23670): stdout: | (launched: 2022-12-10_16:21:00.987751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:02.951634 run osmo-stp_10.42.42.5(pid=23670): stderr: | [0;m[38;5;43m20221210162101328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162101334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162101339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162101345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162101345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162101345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162101345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:03.094266 run patchelf(pid=23673): Terminating (SIGINT) 16:21:03.258541 run patchelf(pid=23673): Terminated: ok {rc=0} 16:21:03.377277 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23670): Process ended prematurely: osmo-stp_10.42.42.5(pid=23670) [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23670)] [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:21:03.386375 tst ping.py:22: Test FAILED (6.6 sec) 16:21:03.414112 run osmo-hlr_10.42.42.2(pid=23667): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23667)] 16:21:03.462094 run osmo-hlr_10.42.42.2(pid=23667): stdout: | (launched: 2022-12-10_16:21:00.004765) 16:21:03.511500 run osmo-hlr_10.42.42.2(pid=23667): stderr: | [0;m[1;31m20221210162100202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162100202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162100202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162100202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162100202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162100202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162100214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162100223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162100223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162100223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:03.561791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23666): Terminating (SIGTERM) 16:21:03.602188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23669): Terminating (SIGTERM) 16:21:03.642440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23672): Terminating (SIGTERM) 16:21:03.683014 --- ParallelTerminationStrategy: PID 23666 died... 16:21:03.702234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23666): Terminated: ok {rc=0} 16:21:03.747196 --- ParallelTerminationStrategy: PID 23669 died... 16:21:03.766080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23669): Terminated: ok {rc=0} 16:21:03.811517 --- ParallelTerminationStrategy: PID 23672 died... 16:21:03.830651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23672): Terminated: ok {rc=0} 16:21:03.916161 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:21:05.001974 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:05.013975 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:21:05.066664 tst ping_idle_ping.py: using LAC 29163 16:21:05.183146 tst ping_idle_ping.py: using RAC 93 16:21:05.298482 tst ping_idle_ping.py: using CellId 29163 16:21:05.413591 tst ping_idle_ping.py: using BVCI 29164 16:21:05.519921 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:05.531492 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:05.542773 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:05.554578 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:05.566356 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:05.578013 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:05.589734 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:05.601392 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:21:05.717565 tst ping_idle_ping.py:24: start network... 16:21:05.929530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:06.416087 run create_hlr_db(pid=23674): Launched 16:21:06.543311 bus /gobi_6: Setting Powered False 16:21:07.605917 run create_hlr_db(pid=23674): Terminated: ok {rc=0} 16:21:08.025264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23676): Launched 16:21:08.317042 run osmo-hlr_10.42.42.2(pid=23677): Launched 16:21:08.427840 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:08.946376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23679): Launched 16:21:09.238016 run osmo-stp_10.42.42.5(pid=23680): Launched 16:21:09.349190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:09.853502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23682): Launched 16:21:09.966251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:10.218044 run patchelf(pid=23683): Launched 16:21:10.391746 run osmo-stp_10.42.42.5(pid=23680): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23680)] 16:21:10.523559 run osmo-stp_10.42.42.5(pid=23680): stdout: | (launched: 2022-12-10_16:21:09.184397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:10.657510 run osmo-stp_10.42.42.5(pid=23680): stderr: | [0;m[38;5;43m20221210162109352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162109353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162109353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162109353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162109356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162109356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162109356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:10.791337 run osmo-stp_10.42.42.5(pid=23680): stdout: | (launched: 2022-12-10_16:21:09.184397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:10.919841 run osmo-stp_10.42.42.5(pid=23680): stderr: | [0;m[38;5;43m20221210162109352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162109353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162109353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162109353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162109356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162109356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162109356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:11.071546 run patchelf(pid=23683): Terminating (SIGINT) 16:21:11.246500 run patchelf(pid=23683): Terminated: ok {rc=0} 16:21:11.372070 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23680): Process ended prematurely: osmo-stp_10.42.42.5(pid=23680) [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23680)] [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:21:11.381663 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:21:11.409799 run osmo-hlr_10.42.42.2(pid=23677): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23677)] 16:21:11.459545 run osmo-hlr_10.42.42.2(pid=23677): stdout: | (launched: 2022-12-10_16:21:08.263291) 16:21:11.511156 run osmo-hlr_10.42.42.2(pid=23677): stderr: | [0;m[1;31m20221210162108436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162108436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162108437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162108437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162108437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162108437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162108448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162108457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162108457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162108457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:11.563117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23676): Terminating (SIGTERM) 16:21:11.604913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23679): Terminating (SIGTERM) 16:21:11.647253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23682): Terminating (SIGTERM) 16:21:11.689895 --- ParallelTerminationStrategy: PID 23676 died... 16:21:11.709822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23676): Terminated: ok {rc=0} 16:21:11.756026 --- ParallelTerminationStrategy: PID 23679 died... 16:21:11.775640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23679): Terminated: ok {rc=0} 16:21:11.821507 --- ParallelTerminationStrategy: PID 23682 died... 16:21:11.840856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23682): Terminated: ok {rc=0} 16:21:11.928686 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:21:13.243683 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:13.250931 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:21:13.284006 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:21:13.319111 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:21:13.373254 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:21:13.406107 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:21:13.441288 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:21:14.007662 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:21:14.012811 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:14.024429 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:21:14.094462 tst switch_tch_pdch.py: using LAC 29164 16:21:14.217308 tst switch_tch_pdch.py: using RAC 94 16:21:14.338825 tst switch_tch_pdch.py: using CellId 29164 16:21:14.461168 tst switch_tch_pdch.py: using BVCI 29165 16:21:14.575149 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:14.586748 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:14.598239 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:14.609743 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:14.621129 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:14.632478 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:14.644012 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:14.655508 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:21:14.767389 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:21:14.885629 tst switch_tch_pdch.py:51: start network... 16:21:15.095764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:15.577273 run create_hlr_db(pid=23689): Launched 16:21:15.703119 bus /gobi_6: Setting Powered False 16:21:16.766629 run create_hlr_db(pid=23689): Terminated: ok {rc=0} 16:21:17.196659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23691): Launched 16:21:17.490680 run osmo-hlr_10.42.42.2(pid=23692): Launched 16:21:17.603166 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:18.119983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23694): Launched 16:21:18.410148 run osmo-stp_10.42.42.5(pid=23695): Launched 16:21:18.520858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:19.023407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23697): Launched 16:21:19.134547 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:19.380576 run patchelf(pid=23698): Launched 16:21:19.541790 run osmo-stp_10.42.42.5(pid=23695): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23695)] 16:21:19.665302 run osmo-stp_10.42.42.5(pid=23695): stdout: | (launched: 2022-12-10_16:21:18.356608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:19.790265 run osmo-stp_10.42.42.5(pid=23695): stderr: | [0;m[38;5;43m20221210162118525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162118525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162118525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162118526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162118528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162118528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162118528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:19.915498 run osmo-stp_10.42.42.5(pid=23695): stdout: | (launched: 2022-12-10_16:21:18.356608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:20.034780 run osmo-stp_10.42.42.5(pid=23695): stderr: | [0;m[38;5;43m20221210162118525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162118525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162118525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162118526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162118528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162118528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162118528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:20.176808 run patchelf(pid=23698): Terminating (SIGINT) 16:21:20.339896 run patchelf(pid=23698): Terminated: ok {rc=0} 16:21:20.457998 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23695): Process ended prematurely: osmo-stp_10.42.42.5(pid=23695) [trial-2376↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23695)] [trial-2376↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:21:20.466799 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 16:21:20.493599 run osmo-hlr_10.42.42.2(pid=23692): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23692)] 16:21:20.541288 run osmo-hlr_10.42.42.2(pid=23692): stdout: | (launched: 2022-12-10_16:21:17.436657) 16:21:20.590606 run osmo-hlr_10.42.42.2(pid=23692): stderr: | [0;m[1;31m20221210162117612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162117612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162117612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162117612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162117613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162117613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162117625 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162117635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162117635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162117635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:20.640360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23691): Terminating (SIGTERM) 16:21:20.680130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23694): Terminating (SIGTERM) 16:21:20.720362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23697): Terminating (SIGTERM) 16:21:20.760576 --- ParallelTerminationStrategy: PID 23691 died... 16:21:20.779703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23691): Terminated: ok {rc=0} 16:21:20.824250 --- ParallelTerminationStrategy: PID 23694 died... 16:21:20.843015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23694): Terminated: ok {rc=0} 16:21:20.887545 --- ParallelTerminationStrategy: PID 23697 died... 16:21:20.906063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23697): Terminated: ok {rc=0} 16:21:20.991990 bus /gobi_0: Setting Powered False 16:21:22.092283 bus /gobi_0: Setting Powered False 16:21:23.206283 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:21:24.457358 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:24.464880 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:21:24.498172 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:21:24.533866 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:21:24.586858 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:21:24.618870 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:21:24.652825 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:21:25.209393 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:21:25.215861 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:25.227637 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:21:25.296799 tst switch_tch_pdch.py: using LAC 29165 16:21:25.421408 tst switch_tch_pdch.py: using RAC 95 16:21:25.542183 tst switch_tch_pdch.py: using CellId 29165 16:21:25.662676 tst switch_tch_pdch.py: using BVCI 29166 16:21:25.774823 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:25.786273 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:25.797512 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:25.808691 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:25.819869 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:25.831128 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:25.842440 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:25.853604 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:21:25.966267 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:21:26.078671 tst switch_tch_pdch.py:51: start network... 16:21:26.274208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:26.699353 run create_hlr_db(pid=23703): Launched 16:21:26.810517 bus /gobi_6: Setting Powered False 16:21:27.869392 run create_hlr_db(pid=23703): Terminated: ok {rc=0} 16:21:28.270507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23705): Launched 16:21:28.582174 run osmo-hlr_10.42.42.2(pid=23706): Launched 16:21:28.701064 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:29.214652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23708): Launched 16:21:29.525268 run osmo-stp_10.42.42.5(pid=23709): Launched 16:21:29.643675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:30.154053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23711): Launched 16:21:30.273443 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:30.535558 run patchelf(pid=23712): Launched 16:21:30.707617 run osmo-stp_10.42.42.5(pid=23709): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23709)] 16:21:30.854970 run osmo-stp_10.42.42.5(pid=23709): stdout: | (launched: 2022-12-10_16:21:29.468424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:30.998520 run osmo-stp_10.42.42.5(pid=23709): stderr: | [0;m[38;5;43m20221210162129659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162129659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162129659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162129660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162129660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162129660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162129660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:31.134881 run osmo-stp_10.42.42.5(pid=23709): stdout: | (launched: 2022-12-10_16:21:29.468424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:31.264622 run osmo-stp_10.42.42.5(pid=23709): stderr: | [0;m[38;5;43m20221210162129659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162129659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162129659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162129660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162129660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162129660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162129660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:31.418524 run patchelf(pid=23712): Terminating (SIGINT) 16:21:31.595452 run patchelf(pid=23712): Terminated: ok {rc=0} 16:21:31.723243 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23709): Process ended prematurely: osmo-stp_10.42.42.5(pid=23709) [trial-2376↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23709)] [trial-2376↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:21:31.733444 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:21:31.762489 run osmo-hlr_10.42.42.2(pid=23706): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23706)] 16:21:31.813569 run osmo-hlr_10.42.42.2(pid=23706): stdout: | (launched: 2022-12-10_16:21:28.525328) 16:21:31.866094 run osmo-hlr_10.42.42.2(pid=23706): stderr: | [0;m[1;31m20221210162128724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162128724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162128724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162128724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162128724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162128724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162128735 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162128743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162128743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162128743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:31.919674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23705): Terminating (SIGTERM) 16:21:31.962391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23708): Terminating (SIGTERM) 16:21:32.005154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23711): Terminating (SIGTERM) 16:21:32.047734 --- ParallelTerminationStrategy: PID 23705 died... 16:21:32.067705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23705): Terminated: ok {rc=0} 16:21:32.114649 --- ParallelTerminationStrategy: PID 23708 died... 16:21:32.134639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23708): Terminated: ok {rc=0} 16:21:32.181427 --- ParallelTerminationStrategy: PID 23711 died... 16:21:32.201426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23711): Terminated: ok {rc=0} 16:21:32.288860 bus /gobi_0: Setting Powered False 16:21:33.387262 bus /gobi_0: Setting Powered False 16:21:34.503274 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_sms:trx-lms --------------------------------------------------------------------- 16:21:35.755530 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:35.759783 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 16:21:35.793767 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 16:21:35.800687 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 16:21:35.854225 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 16:21:35.887879 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 16:21:35.894760 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 16:21:36.432433 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 16:21:36.437635 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 16:21:36.448757 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 16:21:36.497474 tst mo_mt_sms.py: using LAC 29166 16:21:36.618209 tst mo_mt_sms.py: using RAC 96 16:21:36.739737 tst mo_mt_sms.py: using CellId 29166 16:21:36.861178 tst mo_mt_sms.py: using BVCI 29167 16:21:36.975447 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 16:21:37.088644 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 16:21:37.203786 tst mo_mt_sms.py:9: start nitb and bts... 16:21:37.414289 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:21:38.049234 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23716): Launched 16:21:38.359867 run osmo-nitb_10.42.42.2(pid=23717): Launched 16:21:38.531353 run osmo-nitb_10.42.42.2(pid=23717): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23717)] 16:21:38.670653 run osmo-nitb_10.42.42.2(pid=23717): stdout: | (launched: 2022-12-10_16:21:38.303196) 16:21:38.811472 run osmo-nitb_10.42.42.2(pid=23717): stderr: | (launched: 2022-12-10_16:21:38.349448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:21:38.952362 run osmo-nitb_10.42.42.2(pid=23717): stdout: | (launched: 2022-12-10_16:21:38.303196) 16:21:39.087495 run osmo-nitb_10.42.42.2(pid=23717): stderr: | (launched: 2022-12-10_16:21:38.349448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23717): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23717) [trial-2376↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23717)] 16:21:39.476118 tst osmo-nitb_10.42.42.2(pid=23717): stdout: | (launched: 2022-12-10_16:21:38.303196) 16:21:39.602328 tst osmo-nitb_10.42.42.2(pid=23717): stderr: | (launched: 2022-12-10_16:21:38.349448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:21:39.750515 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23717): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23717) [trial-2376↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23717)] [trial-2376↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 16:21:39.759592 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:21:39.766832 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23716): Terminating (SIGTERM) 16:21:39.977451 --- ParallelTerminationStrategy: PID 23716 died... 16:21:39.999315 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23716): Terminated: ok {rc=0} 16:21:40.086816 bus /sierra_3: Setting Powered False 16:21:41.186021 bus /sierra_3: Setting Powered False 16:21:42.304482 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 sms:trx-lms --------------------------------------------------------------------- 16:21:43.501472 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:43.505423 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 16:21:43.538954 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:21:43.565514 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 16:21:43.618862 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 16:21:43.652489 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:21:43.678850 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 16:21:44.225898 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 16:21:44.232056 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:44.243651 tst sms:trx-lms: Using 1 x bts (candidates: 1) 16:21:44.295655 tst mo_mt_sms.py: using LAC 29167 16:21:44.419719 tst mo_mt_sms.py: using RAC 97 16:21:44.535986 tst mo_mt_sms.py: using CellId 29167 16:21:44.651258 tst mo_mt_sms.py: using BVCI 29168 16:21:44.756514 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:44.767165 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:44.777702 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:44.788363 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:44.798897 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:44.809489 tst sms:trx-lms: Using 1 x modem (candidates: 2) 16:21:44.926128 tst sms:trx-lms: Using 1 x modem (candidates: 2) 16:21:45.043835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:45.526361 run create_hlr_db(pid=23721): Launched 16:21:45.653820 bus /sierra_2: Setting Powered False 16:21:46.717613 run create_hlr_db(pid=23721): Terminated: ok {rc=0} 16:21:47.169710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23723): Launched 16:21:47.483799 run osmo-hlr_10.42.42.2(pid=23724): Launched 16:21:47.602249 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:48.142640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23726): Launched 16:21:48.453447 run osmo-stp_10.42.42.5(pid=23727): Launched 16:21:48.571296 run osmo-msc_10.42.42.6: Starting osmo-msc 16:21:49.135400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23729): Launched 16:21:49.445501 run osmo-msc_10.42.42.6(pid=23730): Launched 16:21:49.618894 run osmo-stp_10.42.42.5(pid=23727): ERR: Terminated: ERROR {rc=1} [trial-2376↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23727)] 16:21:49.749652 run osmo-stp_10.42.42.5(pid=23727): stdout: | (launched: 2022-12-10_16:21:48.396724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:49.881301 run osmo-stp_10.42.42.5(pid=23727): stderr: | [0;m[38;5;43m20221210162148588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162148589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162148589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162148589 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162148590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162148590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162148590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:50.013097 run osmo-stp_10.42.42.5(pid=23727): stdout: | (launched: 2022-12-10_16:21:48.396724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:50.137098 run osmo-stp_10.42.42.5(pid=23727): stderr: | [0;m[38;5;43m20221210162148588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162148589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162148589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162148589 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162148590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162148590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162148590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:50.285481 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23727): Process ended prematurely: osmo-stp_10.42.42.5(pid=23727) [trial-2376↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23727)] [trial-2376↪sms:trx-lms↪mo_mt_sms.py:16] 16:21:50.294467 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 16:21:50.321864 run osmo-hlr_10.42.42.2(pid=23724): ERR: Terminated: ERROR {rc=237} [trial-2376↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23724)] 16:21:50.371768 run osmo-hlr_10.42.42.2(pid=23724): stdout: | (launched: 2022-12-10_16:21:47.427002) 16:21:50.423002 run osmo-hlr_10.42.42.2(pid=23724): stderr: | [0;m[1;31m20221210162147624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162147624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162147624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162147624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162147625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162147625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162147637 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162147646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162147646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162147646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:50.494572 run osmo-msc_10.42.42.6(pid=23730): ERR: Terminated: ERROR {rc=2} [trial-2376↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23730)] 16:21:50.544085 run osmo-msc_10.42.42.6(pid=23730): stdout: | (launched: 2022-12-10_16:21:49.388804) 16:21:50.595067 run osmo-msc_10.42.42.6(pid=23730): stderr: | [0;m[38;5;43m20221210162149709 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162149710 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa748ee0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162149710 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162149710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162149710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162149710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162149712 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162149712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162149712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162149712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:21:50.646598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23723): Terminating (SIGTERM) 16:21:50.687775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23726): Terminating (SIGTERM) 16:21:50.728942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23729): Terminating (SIGTERM) 16:21:50.770620 --- ParallelTerminationStrategy: PID 23723 died... 16:21:50.790426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23723): Terminated: ok {rc=0} 16:21:50.836290 --- ParallelTerminationStrategy: PID 23726 died... 16:21:50.855554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23726): Terminated: ok {rc=0} 16:21:50.901107 --- ParallelTerminationStrategy: PID 23729 died... 16:21:50.920400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23729): Terminated: ok {rc=0} 16:21:51.007323 bus /sierra_3: Setting Powered False 16:21:52.106317 bus /sierra_3: Setting Powered False 16:21:53.222818 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_ussd:trx-lms --------------------------------------------------------------------- 16:21:54.454485 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:54.458699 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 16:21:54.492657 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 16:21:54.499900 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 16:21:54.538427 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 16:21:54.572615 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 16:21:54.579561 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 16:21:55.095059 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2376 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 16:21:55.100129 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 16:21:55.110950 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 16:21:55.158347 tst assert_extension.py: using LAC 29168 16:21:55.274547 tst assert_extension.py: using RAC 98 16:21:55.389020 tst assert_extension.py: using CellId 29168 16:21:55.512789 tst assert_extension.py: using BVCI 29169 16:21:55.626684 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 16:21:55.741893 tst assert_extension.py:10: start nitb and bts... 16:21:55.951290 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:21:56.586468 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23735): Launched 16:21:56.895931 run osmo-nitb_10.42.42.2(pid=23736): Launched 16:21:57.068214 run osmo-nitb_10.42.42.2(pid=23736): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23736)] 16:21:57.207578 run osmo-nitb_10.42.42.2(pid=23736): stdout: | (launched: 2022-12-10_16:21:56.839311) 16:21:57.348513 run osmo-nitb_10.42.42.2(pid=23736): stderr: | (launched: 2022-12-10_16:21:56.885636) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:21:57.489781 run osmo-nitb_10.42.42.2(pid=23736): stdout: | (launched: 2022-12-10_16:21:56.839311) 16:21:57.625144 run osmo-nitb_10.42.42.2(pid=23736): stderr: | (launched: 2022-12-10_16:21:56.885636) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23736): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23736) [trial-2376↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23736)] 16:21:58.013712 tst osmo-nitb_10.42.42.2(pid=23736): stdout: | (launched: 2022-12-10_16:21:56.839311) 16:21:58.139496 tst osmo-nitb_10.42.42.2(pid=23736): stderr: | (launched: 2022-12-10_16:21:56.885636) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:21:58.288129 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23736): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23736) [trial-2376↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23736)] [trial-2376↪nitb_ussd:trx-lms↪assert_extension.py:12] 16:21:58.297161 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:21:58.304540 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23735): Terminating (SIGTERM) 16:21:58.515206 --- ParallelTerminationStrategy: PID 23735 died... 16:21:58.536879 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23735): Terminated: ok {rc=0} 16:21:58.625505 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 ussd:trx-lms --------------------------------------------------------------------- 16:21:59.806979 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:59.811080 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 16:21:59.845296 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:21:59.872574 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 16:21:59.907370 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 16:21:59.942126 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:21:59.969737 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 16:22:00.497900 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 ussd:trx-lms assert_extension.py ---------------------------------------------- 16:22:00.503415 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:00.514621 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 16:22:00.563936 tst assert_extension.py: using LAC 29169 16:22:00.684165 tst assert_extension.py: using RAC 99 16:22:00.804379 tst assert_extension.py: using CellId 29169 16:22:00.931145 tst assert_extension.py: using BVCI 29170 16:22:01.057100 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:01.068587 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:01.080153 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:01.093355 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:01.106690 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:01.120060 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 16:22:01.256215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:01.771174 run create_hlr_db(pid=23740): Launched 16:22:01.921901 bus /sierra_2: Setting Powered False 16:22:02.979720 run create_hlr_db(pid=23740): Terminated: ok {rc=0} 16:22:03.407931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23742): Launched 16:22:03.718697 run osmo-hlr_10.42.42.2(pid=23743): Launched 16:22:03.836385 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:04.372916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23745): Launched 16:22:04.684398 run osmo-stp_10.42.42.5(pid=23746): Launched 16:22:04.801888 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:05.363400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23748): Launched 16:22:05.667313 run osmo-msc_10.42.42.6(pid=23749): Launched 16:22:05.831777 run osmo-stp_10.42.42.5(pid=23746): ERR: Terminated: ERROR {rc=1} [trial-2376↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23746)] 16:22:05.955973 run osmo-stp_10.42.42.5(pid=23746): stdout: | (launched: 2022-12-10_16:22:04.627095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:06.079926 run osmo-stp_10.42.42.5(pid=23746): stderr: | [0;m[38;5;43m20221210162204818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162204818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162204818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162204819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162204821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162204821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162204821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:06.201675 run osmo-stp_10.42.42.5(pid=23746): stdout: | (launched: 2022-12-10_16:22:04.627095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:06.317755 run osmo-stp_10.42.42.5(pid=23746): stderr: | [0;m[38;5;43m20221210162204818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162204818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162204818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162204819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162204821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162204821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162204821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:06.457072 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23746): Process ended prematurely: osmo-stp_10.42.42.5(pid=23746) [trial-2376↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23746)] [trial-2376↪ussd:trx-lms↪assert_extension.py:17] 16:22:06.465337 tst assert_extension.py:17: Test FAILED (6.0 sec) 16:22:06.491568 run osmo-hlr_10.42.42.2(pid=23743): ERR: Terminated: ERROR {rc=237} [trial-2376↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23743)] 16:22:06.539502 run osmo-hlr_10.42.42.2(pid=23743): stdout: | (launched: 2022-12-10_16:22:03.662208) 16:22:06.589205 run osmo-hlr_10.42.42.2(pid=23743): stderr: | [0;m[1;31m20221210162203857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162203857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162203857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162203857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162203858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162203858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162203871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162203879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162203880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162203880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:06.657936 run osmo-msc_10.42.42.6(pid=23749): ERR: Terminated: ERROR {rc=2} [trial-2376↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23749)] 16:22:06.705816 run osmo-msc_10.42.42.6(pid=23749): stdout: | (launched: 2022-12-10_16:22:05.613844) 16:22:06.755100 run osmo-msc_10.42.42.6(pid=23749): stderr: | [0;m[38;5;43m20221210162205881 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162205881 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f87421bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162205882 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162205882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162205882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162205882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162205884 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162205884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162205884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162205884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:06.805045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23742): Terminating (SIGTERM) 16:22:06.844900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23745): Terminating (SIGTERM) 16:22:06.885024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23748): Terminating (SIGTERM) 16:22:06.925597 --- ParallelTerminationStrategy: PID 23742 died... 16:22:06.944849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23742): Terminated: ok {rc=0} 16:22:06.989834 --- ParallelTerminationStrategy: PID 23745 died... 16:22:07.008606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23745): Terminated: ok {rc=0} 16:22:07.053219 --- ParallelTerminationStrategy: PID 23748 died... 16:22:07.071898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23748): Terminated: ok {rc=0} 16:22:07.159191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:22:08.367829 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:22:08.374629 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:22:08.408027 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:22:08.434509 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:22:08.486875 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:22:08.520208 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:22:08.546435 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:22:09.095133 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:22:09.143724 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:09.154852 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:22:09.223591 tst mo_mt_call.py: using LAC 29170 16:22:09.340451 tst mo_mt_call.py: using RAC 100 16:22:09.460164 tst mo_mt_call.py: using CellId 29170 16:22:09.576041 tst mo_mt_call.py: using BVCI 29171 16:22:09.682635 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:09.693649 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:09.704340 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:09.715451 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:09.726617 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:09.737724 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:22:09.854524 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:22:09.970175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:10.427094 run create_hlr_db(pid=23754): Launched 16:22:10.540410 bus /sierra_2: Setting Powered False 16:22:11.599904 run create_hlr_db(pid=23754): Terminated: ok {rc=0} 16:22:12.032359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23756): Launched 16:22:12.347985 run osmo-hlr_10.42.42.2(pid=23757): Launched 16:22:12.467403 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:13.011009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23759): Launched 16:22:13.325640 run osmo-stp_10.42.42.5(pid=23760): Launched 16:22:13.446238 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:14.019954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23762): Launched 16:22:14.335319 run osmo-msc_10.42.42.6(pid=23763): Launched 16:22:14.510936 run osmo-stp_10.42.42.5(pid=23760): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23760)] 16:22:14.643921 run osmo-stp_10.42.42.5(pid=23760): stdout: | (launched: 2022-12-10_16:22:13.268188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:14.777106 run osmo-stp_10.42.42.5(pid=23760): stderr: | [0;m[38;5;43m20221210162213460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162213460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162213461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162213461 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162213462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162213462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162213462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:14.910008 run osmo-stp_10.42.42.5(pid=23760): stdout: | (launched: 2022-12-10_16:22:13.268188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:15.036204 run osmo-stp_10.42.42.5(pid=23760): stderr: | [0;m[38;5;43m20221210162213460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162213460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162213461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162213461 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162213462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162213462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162213462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:15.186819 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23760): Process ended prematurely: osmo-stp_10.42.42.5(pid=23760) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23760)] [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:22:15.196175 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:22:15.223932 run osmo-hlr_10.42.42.2(pid=23757): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23757)] 16:22:15.274076 run osmo-hlr_10.42.42.2(pid=23757): stdout: | (launched: 2022-12-10_16:22:12.290425) 16:22:15.325776 run osmo-hlr_10.42.42.2(pid=23757): stderr: | [0;m[1;31m20221210162212486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162212486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162212486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162212486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162212486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162212486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162212498 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162212507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162212507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162212507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:15.397793 run osmo-msc_10.42.42.6(pid=23763): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23763)] 16:22:15.447588 run osmo-msc_10.42.42.6(pid=23763): stdout: | (launched: 2022-12-10_16:22:14.277861) 16:22:15.499047 run osmo-msc_10.42.42.6(pid=23763): stderr: | [0;m[38;5;43m20221210162214599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162214599 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc9da7bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162214599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162214599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162214600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162214600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162214602 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162214602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162214602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162214602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:15.551237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23756): Terminating (SIGTERM) 16:22:15.592853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23759): Terminating (SIGTERM) 16:22:15.634390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23762): Terminating (SIGTERM) 16:22:15.676243 --- ParallelTerminationStrategy: PID 23756 died... 16:22:15.696167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23756): Terminated: ok {rc=0} 16:22:15.742752 --- ParallelTerminationStrategy: PID 23759 died... 16:22:15.762276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23759): Terminated: ok {rc=0} 16:22:15.808284 --- ParallelTerminationStrategy: PID 23762 died... 16:22:15.827946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23762): Terminated: ok {rc=0} 16:22:15.944444 bus /sierra_3: Setting Powered False 16:22:17.064304 bus /sierra_3: Setting Powered False 16:22:18.183317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:22:19.329126 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:19.340793 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:22:19.409392 tst mo_mt_call_osmux.py: using LAC 29171 16:22:19.523759 tst mo_mt_call_osmux.py: using RAC 101 16:22:19.639203 tst mo_mt_call_osmux.py: using CellId 29171 16:22:19.754433 tst mo_mt_call_osmux.py: using BVCI 29172 16:22:19.864171 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:19.875492 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:19.886578 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:19.898160 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:19.909647 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:19.921261 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:22:20.035991 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:22:20.157042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:20.649554 run create_hlr_db(pid=23765): Launched 16:22:20.779020 bus /sierra_2: Setting Powered False 16:22:21.841704 run create_hlr_db(pid=23765): Terminated: ok {rc=0} 16:22:22.266144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23767): Launched 16:22:22.564823 run osmo-hlr_10.42.42.2(pid=23768): Launched 16:22:22.679367 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:23.191247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23770): Launched 16:22:23.487535 run osmo-stp_10.42.42.5(pid=23771): Launched 16:22:23.600301 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:24.137797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23773): Launched 16:22:24.434510 run osmo-msc_10.42.42.6(pid=23774): Launched 16:22:24.600798 run osmo-stp_10.42.42.5(pid=23771): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23771)] 16:22:24.727332 run osmo-stp_10.42.42.5(pid=23771): stdout: | (launched: 2022-12-10_16:22:23.433263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:24.854415 run osmo-stp_10.42.42.5(pid=23771): stderr: | [0;m[38;5;43m20221210162223603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162223603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162223603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162223604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162223606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162223606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162223606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:24.978736 run osmo-stp_10.42.42.5(pid=23771): stdout: | (launched: 2022-12-10_16:22:23.433263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:25.097174 run osmo-stp_10.42.42.5(pid=23771): stderr: | [0;m[38;5;43m20221210162223603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162223603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162223603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162223604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162223606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162223606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162223606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:25.238899 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23771): Process ended prematurely: osmo-stp_10.42.42.5(pid=23771) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23771)] [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:22:25.247729 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:22:25.274958 run osmo-hlr_10.42.42.2(pid=23768): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23768)] 16:22:25.323603 run osmo-hlr_10.42.42.2(pid=23768): stdout: | (launched: 2022-12-10_16:22:22.510026) 16:22:25.373629 run osmo-hlr_10.42.42.2(pid=23768): stderr: | [0;m[1;31m20221210162222686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162222686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162222686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162222686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162222686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162222686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162222702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162222712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162222712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162222712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:25.443404 run osmo-msc_10.42.42.6(pid=23774): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23774)] 16:22:25.491875 run osmo-msc_10.42.42.6(pid=23774): stdout: | (launched: 2022-12-10_16:22:24.380187) 16:22:25.541872 run osmo-msc_10.42.42.6(pid=23774): stderr: | [0;m[38;5;43m20221210162224652 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162224652 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb43dd36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162224652 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162224652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162224652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162224652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162224654 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162224655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162224655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162224655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:25.592288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23767): Terminating (SIGTERM) 16:22:25.632825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23770): Terminating (SIGTERM) 16:22:25.673400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23773): Terminating (SIGTERM) 16:22:25.713982 --- ParallelTerminationStrategy: PID 23767 died... 16:22:25.733463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23767): Terminated: ok {rc=0} 16:22:25.778773 --- ParallelTerminationStrategy: PID 23770 died... 16:22:25.797715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23770): Terminated: ok {rc=0} 16:22:25.842731 --- ParallelTerminationStrategy: PID 23773 died... 16:22:25.861638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23773): Terminated: ok {rc=0} 16:22:25.949084 bus /sierra_3: Setting Powered False 16:22:27.050306 bus /sierra_3: Setting Powered False 16:22:28.168296 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:22:29.419198 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:22:29.425785 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:22:29.459421 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:22:29.486235 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:22:29.539638 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:22:29.573875 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:22:29.600488 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:22:30.148077 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:22:30.196224 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:30.207454 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:22:30.275801 tst mo_mt_call.py: using LAC 29172 16:22:30.392005 tst mo_mt_call.py: using RAC 102 16:22:30.508186 tst mo_mt_call.py: using CellId 29172 16:22:30.624864 tst mo_mt_call.py: using BVCI 29173 16:22:30.732422 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:30.743446 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:30.754374 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:30.765721 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:30.776844 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:30.788033 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:22:30.909845 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:22:31.034128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:31.545198 run create_hlr_db(pid=23779): Launched 16:22:31.707295 bus /sierra_2: Setting Powered False 16:22:32.770488 run create_hlr_db(pid=23779): Terminated: ok {rc=0} 16:22:33.196775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23781): Launched 16:22:33.517282 run osmo-hlr_10.42.42.2(pid=23782): Launched 16:22:33.639009 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:34.188526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23784): Launched 16:22:34.505530 run osmo-stp_10.42.42.5(pid=23785): Launched 16:22:34.626711 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:35.201721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23787): Launched 16:22:35.519645 run osmo-msc_10.42.42.6(pid=23788): Launched 16:22:35.695551 run osmo-stp_10.42.42.5(pid=23785): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23785)] 16:22:35.828601 run osmo-stp_10.42.42.5(pid=23785): stdout: | (launched: 2022-12-10_16:22:34.447804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:35.962743 run osmo-stp_10.42.42.5(pid=23785): stderr: | [0;m[38;5;43m20221210162234640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162234640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162234640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162234641 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162234641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162234641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162234641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:36.099350 run osmo-stp_10.42.42.5(pid=23785): stdout: | (launched: 2022-12-10_16:22:34.447804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:36.226097 run osmo-stp_10.42.42.5(pid=23785): stderr: | [0;m[38;5;43m20221210162234640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162234640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162234640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162234641 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162234641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162234641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162234641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:36.377333 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23785): Process ended prematurely: osmo-stp_10.42.42.5(pid=23785) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23785)] [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:22:36.386877 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:22:36.414575 run osmo-hlr_10.42.42.2(pid=23782): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23782)] 16:22:36.464593 run osmo-hlr_10.42.42.2(pid=23782): stdout: | (launched: 2022-12-10_16:22:33.459431) 16:22:36.516469 run osmo-hlr_10.42.42.2(pid=23782): stderr: | [0;m[1;31m20221210162233657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162233657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162233657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162233657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162233657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162233657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162233670 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162233678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162233678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162233678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:36.588607 run osmo-msc_10.42.42.6(pid=23788): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23788)] 16:22:36.638528 run osmo-msc_10.42.42.6(pid=23788): stdout: | (launched: 2022-12-10_16:22:35.461816) 16:22:36.690026 run osmo-msc_10.42.42.6(pid=23788): stderr: | [0;m[38;5;43m20221210162235782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162235782 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f194f40ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162235782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162235782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162235782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162235783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162235784 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162235785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162235785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162235785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:36.742320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23781): Terminating (SIGTERM) 16:22:36.783902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23784): Terminating (SIGTERM) 16:22:36.825562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23787): Terminating (SIGTERM) 16:22:36.867402 --- ParallelTerminationStrategy: PID 23781 died... 16:22:36.887381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23781): Terminated: ok {rc=0} 16:22:36.933629 --- ParallelTerminationStrategy: PID 23784 died... 16:22:36.953335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23784): Terminated: ok {rc=0} 16:22:36.999859 --- ParallelTerminationStrategy: PID 23787 died... 16:22:37.019464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23787): Terminated: ok {rc=0} 16:22:37.106978 bus /sierra_3: Setting Powered False 16:22:38.206672 bus /sierra_3: Setting Powered False 16:22:39.323246 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:22:40.471417 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:40.483210 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:22:40.553133 tst mo_mt_call_osmux.py: using LAC 29173 16:22:40.670730 tst mo_mt_call_osmux.py: using RAC 103 16:22:40.787524 tst mo_mt_call_osmux.py: using CellId 29173 16:22:40.905645 tst mo_mt_call_osmux.py: using BVCI 29174 16:22:41.021232 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:41.032789 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:41.044261 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:41.055722 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:41.067165 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:41.078538 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:22:41.191770 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:22:41.311678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:41.773582 run create_hlr_db(pid=23790): Launched 16:22:41.887885 bus /sierra_2: Setting Powered False 16:22:42.946702 run create_hlr_db(pid=23790): Terminated: ok {rc=0} 16:22:43.381354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23792): Launched 16:22:43.698277 run osmo-hlr_10.42.42.2(pid=23793): Launched 16:22:43.818326 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:44.370335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23795): Launched 16:22:44.686300 run osmo-stp_10.42.42.5(pid=23796): Launched 16:22:44.806400 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:45.379631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23798): Launched 16:22:45.696048 run osmo-msc_10.42.42.6(pid=23799): Launched 16:22:45.936904 run osmo-stp_10.42.42.5(pid=23796): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23796)] 16:22:46.168630 run osmo-stp_10.42.42.5(pid=23796): stdout: | (launched: 2022-12-10_16:22:44.628509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:46.445314 run osmo-stp_10.42.42.5(pid=23796): stderr: | [0;m[38;5;43m20221210162244823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162244823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162244823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162244823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162244824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162244824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162244824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:46.576150 run osmo-stp_10.42.42.5(pid=23796): stdout: | (launched: 2022-12-10_16:22:44.628509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:46.699551 run osmo-stp_10.42.42.5(pid=23796): stderr: | [0;m[38;5;43m20221210162244823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162244823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162244823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162244823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162244824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162244824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162244824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:46.849139 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23796): Process ended prematurely: osmo-stp_10.42.42.5(pid=23796) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23796)] [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:22:46.859205 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:22:46.888233 run osmo-hlr_10.42.42.2(pid=23793): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23793)] 16:22:46.941442 run osmo-hlr_10.42.42.2(pid=23793): stdout: | (launched: 2022-12-10_16:22:43.640338) 16:22:46.994721 run osmo-hlr_10.42.42.2(pid=23793): stderr: | [0;m[1;31m20221210162243838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162243838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162243838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162243838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162243838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162243838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162243850 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162243858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162243859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162243859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:47.068058 run osmo-msc_10.42.42.6(pid=23799): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23799)] 16:22:47.120236 run osmo-msc_10.42.42.6(pid=23799): stdout: | (launched: 2022-12-10_16:22:45.638192) 16:22:47.174087 run osmo-msc_10.42.42.6(pid=23799): stderr: | [0;m[38;5;43m20221210162246112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162246112 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f85e70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162246112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162246113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162246114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162246114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162246118 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162246118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162246119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162246119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:47.227696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23792): Terminating (SIGTERM) 16:22:47.271015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23795): Terminating (SIGTERM) 16:22:47.314190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23798): Terminating (SIGTERM) 16:22:47.356573 --- ParallelTerminationStrategy: PID 23792 died... 16:22:47.376837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23792): Terminated: ok {rc=0} 16:22:47.423440 --- ParallelTerminationStrategy: PID 23795 died... 16:22:47.442945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23795): Terminated: ok {rc=0} 16:22:47.488867 --- ParallelTerminationStrategy: PID 23798 died... 16:22:47.508312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23798): Terminated: ok {rc=0} 16:22:47.596328 bus /sierra_3: Setting Powered False 16:22:48.696214 bus /sierra_3: Setting Powered False 16:22:49.811719 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:22:51.064582 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:22:51.071690 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:22:51.105489 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:22:51.132810 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:22:51.187084 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:22:51.221076 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:22:51.248326 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:22:51.797885 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:22:51.848487 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:22:51.860106 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:22:51.930699 tst mo_mt_call.py: using LAC 29174 16:22:52.054651 tst mo_mt_call.py: using RAC 104 16:22:52.179618 tst mo_mt_call.py: using CellId 29174 16:22:52.303765 tst mo_mt_call.py: using BVCI 29175 16:22:52.417944 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:22:52.429565 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:22:52.440842 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:22:52.452254 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:22:52.463700 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:22:52.475049 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:22:52.589964 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:22:52.707058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:53.166703 run create_hlr_db(pid=23804): Launched 16:22:53.280093 bus /sierra_2: Setting Powered False 16:22:54.339181 run create_hlr_db(pid=23804): Terminated: ok {rc=0} 16:22:54.775477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23806): Launched 16:22:55.094176 run osmo-hlr_10.42.42.2(pid=23807): Launched 16:22:55.214574 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:55.765783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23809): Launched 16:22:56.083161 run osmo-stp_10.42.42.5(pid=23810): Launched 16:22:56.203978 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:56.777957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23812): Launched 16:22:57.095723 run osmo-msc_10.42.42.6(pid=23813): Launched 16:22:57.271818 run osmo-stp_10.42.42.5(pid=23810): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23810)] 16:22:57.405549 run osmo-stp_10.42.42.5(pid=23810): stdout: | (launched: 2022-12-10_16:22:56.025468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:57.540125 run osmo-stp_10.42.42.5(pid=23810): stderr: | [0;m[38;5;43m20221210162256216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162256216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162256216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162256217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162256217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162256217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162256217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:57.673961 run osmo-stp_10.42.42.5(pid=23810): stdout: | (launched: 2022-12-10_16:22:56.025468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:57.800040 run osmo-stp_10.42.42.5(pid=23810): stderr: | [0;m[38;5;43m20221210162256216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162256216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162256216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162256217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162256217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162256217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162256217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:57.951257 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23810): Process ended prematurely: osmo-stp_10.42.42.5(pid=23810) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23810)] [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:22:57.961142 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:22:57.988837 run osmo-hlr_10.42.42.2(pid=23807): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23807)] 16:22:58.038851 run osmo-hlr_10.42.42.2(pid=23807): stdout: | (launched: 2022-12-10_16:22:55.036226) 16:22:58.090890 run osmo-hlr_10.42.42.2(pid=23807): stderr: | [0;m[1;31m20221210162255235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162255235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162255235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162255235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162255235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162255235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162255248 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162255256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162255256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162255256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:58.162616 run osmo-msc_10.42.42.6(pid=23813): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23813)] 16:22:58.212359 run osmo-msc_10.42.42.6(pid=23813): stdout: | (launched: 2022-12-10_16:22:57.038073) 16:22:58.263693 run osmo-msc_10.42.42.6(pid=23813): stderr: | [0;m[38;5;43m20221210162257359 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162257360 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f424ea97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162257360 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162257360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162257360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162257360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162257362 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162257362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162257362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162257362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:58.315514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23806): Terminating (SIGTERM) 16:22:58.357210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23809): Terminating (SIGTERM) 16:22:58.398780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23812): Terminating (SIGTERM) 16:22:58.440420 --- ParallelTerminationStrategy: PID 23806 died... 16:22:58.460029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23806): Terminated: ok {rc=0} 16:22:58.506196 --- ParallelTerminationStrategy: PID 23809 died... 16:22:58.525636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23809): Terminated: ok {rc=0} 16:22:58.571586 --- ParallelTerminationStrategy: PID 23812 died... 16:22:58.590953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23812): Terminated: ok {rc=0} 16:22:58.678081 bus /sierra_3: Setting Powered False 16:22:59.775270 bus /sierra_3: Setting Powered False 16:23:00.902482 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:23:02.096333 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:02.113415 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:23:02.197271 tst mo_mt_call_osmux.py: using LAC 29175 16:23:02.323896 tst mo_mt_call_osmux.py: using RAC 105 16:23:02.447491 tst mo_mt_call_osmux.py: using CellId 29175 16:23:02.571319 tst mo_mt_call_osmux.py: using BVCI 29176 16:23:02.685929 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:02.697532 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:02.709125 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:02.720665 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:02.732152 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:02.743492 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:23:02.857289 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:23:02.972486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:03.431424 run create_hlr_db(pid=23815): Launched 16:23:03.546790 bus /sierra_2: Setting Powered False 16:23:04.605955 run create_hlr_db(pid=23815): Terminated: ok {rc=0} 16:23:05.042651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23817): Launched 16:23:05.360160 run osmo-hlr_10.42.42.2(pid=23818): Launched 16:23:05.480630 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:06.031485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23820): Launched 16:23:06.347938 run osmo-stp_10.42.42.5(pid=23821): Launched 16:23:06.467834 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:07.042963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23823): Launched 16:23:07.359922 run osmo-msc_10.42.42.6(pid=23824): Launched 16:23:07.536372 run osmo-stp_10.42.42.5(pid=23821): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23821)] 16:23:07.670437 run osmo-stp_10.42.42.5(pid=23821): stdout: | (launched: 2022-12-10_16:23:06.290041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:07.804582 run osmo-stp_10.42.42.5(pid=23821): stderr: | [0;m[38;5;43m20221210162306483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162306483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162306483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162306484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162306484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162306484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162306484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:07.938486 run osmo-stp_10.42.42.5(pid=23821): stdout: | (launched: 2022-12-10_16:23:06.290041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:08.065224 run osmo-stp_10.42.42.5(pid=23821): stderr: | [0;m[38;5;43m20221210162306483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162306483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162306483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162306484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162306484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162306484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162306484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:08.216291 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23821): Process ended prematurely: osmo-stp_10.42.42.5(pid=23821) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23821)] [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:23:08.225888 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:23:08.253748 run osmo-hlr_10.42.42.2(pid=23818): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23818)] 16:23:08.304025 run osmo-hlr_10.42.42.2(pid=23818): stdout: | (launched: 2022-12-10_16:23:05.302405) 16:23:08.355764 run osmo-hlr_10.42.42.2(pid=23818): stderr: | [0;m[1;31m20221210162305500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162305500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162305501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162305501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162305501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162305501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162305515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162305525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162305525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162305525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:08.428253 run osmo-msc_10.42.42.6(pid=23824): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23824)] 16:23:08.478299 run osmo-msc_10.42.42.6(pid=23824): stdout: | (launched: 2022-12-10_16:23:07.302206) 16:23:08.529946 run osmo-msc_10.42.42.6(pid=23824): stderr: | [0;m[38;5;43m20221210162307624 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162307624 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2a4bf57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162307625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162307625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162307625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162307625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162307627 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162307627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162307627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162307627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:08.582060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23817): Terminating (SIGTERM) 16:23:08.623650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23820): Terminating (SIGTERM) 16:23:08.665408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23823): Terminating (SIGTERM) 16:23:08.707420 --- ParallelTerminationStrategy: PID 23817 died... 16:23:08.727537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23817): Terminated: ok {rc=0} 16:23:08.773901 --- ParallelTerminationStrategy: PID 23820 died... 16:23:08.793463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23820): Terminated: ok {rc=0} 16:23:08.839644 --- ParallelTerminationStrategy: PID 23823 died... 16:23:08.859245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23823): Terminated: ok {rc=0} 16:23:08.947103 bus /sierra_3: Setting Powered False 16:23:10.047368 bus /sierra_3: Setting Powered False 16:23:11.163977 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:23:12.417169 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:12.424095 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:23:12.457996 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:23:12.485233 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:23:12.538751 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:23:12.572880 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:23:12.600145 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:23:13.150904 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:23:13.201611 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:13.213162 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:23:13.284077 tst mo_mt_call.py: using LAC 29176 16:23:13.409321 tst mo_mt_call.py: using RAC 106 16:23:13.533017 tst mo_mt_call.py: using CellId 29176 16:23:13.663225 tst mo_mt_call.py: using BVCI 29177 16:23:13.779700 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:13.791231 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:13.802571 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:13.813931 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:13.825351 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:13.836713 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:23:13.953422 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:23:14.066792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:14.526973 run create_hlr_db(pid=23829): Launched 16:23:14.640217 bus /sierra_2: Setting Powered False 16:23:15.699900 run create_hlr_db(pid=23829): Terminated: ok {rc=0} 16:23:16.143900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23831): Launched 16:23:16.470894 run osmo-hlr_10.42.42.2(pid=23832): Launched 16:23:16.712300 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:17.497640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23870): Launched 16:23:17.853110 run osmo-stp_10.42.42.5(pid=23884): Launched 16:23:18.117966 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:18.817686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23987): Launched 16:23:19.205746 run osmo-msc_10.42.42.6(pid=24033): Launched 16:23:19.620713 run osmo-stp_10.42.42.5(pid=23884): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23884)] 16:23:19.910478 run osmo-stp_10.42.42.5(pid=23884): stdout: | (launched: 2022-12-10_16:23:17.791335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:20.186599 run osmo-stp_10.42.42.5(pid=23884): stderr: | [0;m[38;5;43m20221210162318066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162318066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162318066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162318066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162318067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162318067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162318067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:20.354397 run osmo-stp_10.42.42.5(pid=23884): stdout: | (launched: 2022-12-10_16:23:17.791335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:20.478132 run osmo-stp_10.42.42.5(pid=23884): stderr: | [0;m[38;5;43m20221210162318066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162318066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162318066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162318066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162318067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162318067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162318067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:20.625267 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23884): Process ended prematurely: osmo-stp_10.42.42.5(pid=23884) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23884)] [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:23:20.635130 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 16:23:20.665810 run osmo-hlr_10.42.42.2(pid=23832): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23832)] 16:23:20.717167 run osmo-hlr_10.42.42.2(pid=23832): stdout: | (launched: 2022-12-10_16:23:16.402243) 16:23:20.769548 run osmo-hlr_10.42.42.2(pid=23832): stderr: | [0;m[1;31m20221210162316743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162316743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162316743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162316743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162316743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162316743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162316771 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162316779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162316779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162316779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:20.842605 run osmo-msc_10.42.42.6(pid=24033): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24033)] 16:23:20.893599 run osmo-msc_10.42.42.6(pid=24033): stdout: | (launched: 2022-12-10_16:23:19.128227) 16:23:20.946158 run osmo-msc_10.42.42.6(pid=24033): stderr: | [0;m[38;5;43m20221210162319828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162319828 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f523fdeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162319828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162319828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162319829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162319829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162319831 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162319831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162319831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162319831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:20.999123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23831): Terminating (SIGTERM) 16:23:21.042407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23870): Terminating (SIGTERM) 16:23:21.087245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23987): Terminating (SIGTERM) 16:23:21.132566 --- ParallelTerminationStrategy: PID 23831 died... 16:23:21.152901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23831): Terminated: ok {rc=0} 16:23:21.202711 --- ParallelTerminationStrategy: PID 23870 died... 16:23:21.222710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23870): Terminated: ok {rc=0} 16:23:21.271093 --- ParallelTerminationStrategy: PID 23987 died... 16:23:21.291019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23987): Terminated: ok {rc=0} 16:23:21.381905 bus /sierra_3: Setting Powered False 16:23:22.483910 bus /sierra_3: Setting Powered False 16:23:23.601896 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:23:24.753287 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:24.766146 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:23:24.839155 tst mo_mt_call_osmux.py: using LAC 29177 16:23:24.959701 tst mo_mt_call_osmux.py: using RAC 107 16:23:25.079195 tst mo_mt_call_osmux.py: using CellId 29177 16:23:25.199623 tst mo_mt_call_osmux.py: using BVCI 29178 16:23:25.311654 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:25.324922 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:25.338051 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:25.350314 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:25.363275 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:25.376457 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:23:25.496440 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:23:25.617537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:26.101188 run create_hlr_db(pid=24111): Launched 16:23:26.259601 bus /sierra_2: Setting Powered False 16:23:27.321529 run create_hlr_db(pid=24111): Terminated: ok {rc=0} 16:23:27.761369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24113): Launched 16:23:28.088927 run osmo-hlr_10.42.42.2(pid=24114): Launched 16:23:28.334171 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:29.037793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24116): Launched 16:23:29.365321 run osmo-stp_10.42.42.5(pid=24117): Launched 16:23:29.598383 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:30.321859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24119): Launched 16:23:30.646414 run osmo-msc_10.42.42.6(pid=24120): Launched 16:23:31.015075 run osmo-stp_10.42.42.5(pid=24117): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24117)] 16:23:31.375603 run osmo-stp_10.42.42.5(pid=24117): stdout: | (launched: 2022-12-10_16:23:29.301696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:31.650862 run osmo-stp_10.42.42.5(pid=24117): stderr: | [0;m[38;5;43m20221210162329629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162329629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162329629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162329630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162329630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162329630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162329630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:31.786659 run osmo-stp_10.42.42.5(pid=24117): stdout: | (launched: 2022-12-10_16:23:29.301696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:31.916148 run osmo-stp_10.42.42.5(pid=24117): stderr: | [0;m[38;5;43m20221210162329629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162329629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162329629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162329630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162329630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162329630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162329630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:32.072528 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24117): Process ended prematurely: osmo-stp_10.42.42.5(pid=24117) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24117)] [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:23:32.082291 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 16:23:32.110913 run osmo-hlr_10.42.42.2(pid=24114): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24114)] 16:23:32.162452 run osmo-hlr_10.42.42.2(pid=24114): stdout: | (launched: 2022-12-10_16:23:28.026119) 16:23:32.216659 run osmo-hlr_10.42.42.2(pid=24114): stderr: | [0;m[1;31m20221210162328365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162328365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162328365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162328365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162328366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162328366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162328391 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162328404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162328404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162328404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:32.291917 run osmo-msc_10.42.42.6(pid=24120): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24120)] 16:23:32.343907 run osmo-msc_10.42.42.6(pid=24120): stdout: | (launched: 2022-12-10_16:23:30.584165) 16:23:32.397812 run osmo-msc_10.42.42.6(pid=24120): stderr: | [0;m[38;5;43m20221210162331166 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162331166 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f01d09c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162331166 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162331166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162331167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162331167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162331168 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162331169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162331169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162331169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:32.451884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24113): Terminating (SIGTERM) 16:23:32.495711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24116): Terminating (SIGTERM) 16:23:32.539301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24119): Terminating (SIGTERM) 16:23:32.583220 --- ParallelTerminationStrategy: PID 24113 died... 16:23:32.604052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24113): Terminated: ok {rc=0} 16:23:32.652053 --- ParallelTerminationStrategy: PID 24116 died... 16:23:32.672474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24116): Terminated: ok {rc=0} 16:23:32.720460 --- ParallelTerminationStrategy: PID 24119 died... 16:23:32.741078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24119): Terminated: ok {rc=0} 16:23:32.843257 bus /sierra_3: Setting Powered False 16:23:33.950142 bus /sierra_3: Setting Powered False 16:23:35.070310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:23:36.332599 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:36.341091 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:23:36.379168 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:23:36.408047 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:23:36.461048 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:23:36.495869 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:23:36.526040 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:23:37.072173 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:23:37.126119 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:37.138259 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:23:37.210931 tst mo_mt_call.py: using LAC 29178 16:23:37.334093 tst mo_mt_call.py: using RAC 108 16:23:37.457089 tst mo_mt_call.py: using CellId 29178 16:23:37.581828 tst mo_mt_call.py: using BVCI 29179 16:23:37.694690 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:37.707238 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:37.719194 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:37.734084 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:37.746250 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:37.758685 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:23:37.880121 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:23:37.998691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:38.482463 run create_hlr_db(pid=24125): Launched 16:23:38.643572 bus /sierra_2: Setting Powered False 16:23:39.705835 run create_hlr_db(pid=24125): Terminated: ok {rc=0} 16:23:40.149691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24127): Launched 16:23:40.455598 run osmo-hlr_10.42.42.2(pid=24130): Launched 16:23:40.570529 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:41.097843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24132): Launched 16:23:41.395557 run osmo-stp_10.42.42.5(pid=24133): Launched 16:23:41.508295 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:42.045972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24135): Launched 16:23:42.341747 run osmo-msc_10.42.42.6(pid=24136): Launched 16:23:42.506541 run osmo-stp_10.42.42.5(pid=24133): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24133)] 16:23:42.633244 run osmo-stp_10.42.42.5(pid=24133): stdout: | (launched: 2022-12-10_16:23:41.341496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:42.759884 run osmo-stp_10.42.42.5(pid=24133): stderr: | [0;m[38;5;43m20221210162341512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162341512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162341512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162341513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162341513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162341513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162341513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:42.884446 run osmo-stp_10.42.42.5(pid=24133): stdout: | (launched: 2022-12-10_16:23:41.341496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:43.003362 run osmo-stp_10.42.42.5(pid=24133): stderr: | [0;m[38;5;43m20221210162341512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162341512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162341512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162341513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162341513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162341513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162341513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:43.145833 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24133): Process ended prematurely: osmo-stp_10.42.42.5(pid=24133) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24133)] [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:23:43.154942 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:23:43.182344 run osmo-hlr_10.42.42.2(pid=24130): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24130)] 16:23:43.230982 run osmo-hlr_10.42.42.2(pid=24130): stdout: | (launched: 2022-12-10_16:23:40.401272) 16:23:43.280907 run osmo-hlr_10.42.42.2(pid=24130): stderr: | [0;m[1;31m20221210162340574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162340574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162340574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162340574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162340574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162340574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162340586 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162340595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162340595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162340595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:43.350037 run osmo-msc_10.42.42.6(pid=24136): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24136)] 16:23:43.398426 run osmo-msc_10.42.42.6(pid=24136): stdout: | (launched: 2022-12-10_16:23:42.287446) 16:23:43.448125 run osmo-msc_10.42.42.6(pid=24136): stderr: | [0;m[38;5;43m20221210162342557 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162342558 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3257bc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162342558 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162342558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162342558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162342558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162342560 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162342561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162342561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162342561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:43.498241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24127): Terminating (SIGTERM) 16:23:43.538551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24132): Terminating (SIGTERM) 16:23:43.578827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24135): Terminating (SIGTERM) 16:23:43.619308 --- ParallelTerminationStrategy: PID 24127 died... 16:23:43.638216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24127): Terminated: ok {rc=0} 16:23:43.682411 --- ParallelTerminationStrategy: PID 24132 died... 16:23:43.700935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24132): Terminated: ok {rc=0} 16:23:43.745085 --- ParallelTerminationStrategy: PID 24135 died... 16:23:43.763457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24135): Terminated: ok {rc=0} 16:23:43.848073 bus /sierra_3: Setting Powered False 16:23:44.945114 bus /sierra_3: Setting Powered False 16:23:46.071484 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:23:47.227061 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:47.239486 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:23:47.310244 tst mo_mt_call_osmux.py: using LAC 29179 16:23:47.427874 tst mo_mt_call_osmux.py: using RAC 109 16:23:47.546373 tst mo_mt_call_osmux.py: using CellId 29179 16:23:47.664874 tst mo_mt_call_osmux.py: using BVCI 29180 16:23:47.772758 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:47.783887 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:47.794762 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:47.805907 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:47.816943 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:47.828117 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:23:47.945549 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:23:48.062315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:48.521678 run create_hlr_db(pid=24138): Launched 16:23:48.633998 bus /sierra_2: Setting Powered False 16:23:49.694067 run create_hlr_db(pid=24138): Terminated: ok {rc=0} 16:23:50.110397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24140): Launched 16:23:50.407691 run osmo-hlr_10.42.42.2(pid=24141): Launched 16:23:50.521330 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:51.049149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24143): Launched 16:23:51.347045 run osmo-stp_10.42.42.5(pid=24144): Launched 16:23:51.460005 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:51.997151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24146): Launched 16:23:52.294484 run osmo-msc_10.42.42.6(pid=24147): Launched 16:23:52.459965 run osmo-stp_10.42.42.5(pid=24144): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24144)] 16:23:52.585390 run osmo-stp_10.42.42.5(pid=24144): stdout: | (launched: 2022-12-10_16:23:51.291968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:52.711442 run osmo-stp_10.42.42.5(pid=24144): stderr: | [0;m[38;5;43m20221210162351461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162351461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162351461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162351462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162351462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162351462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162351462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:52.835746 run osmo-stp_10.42.42.5(pid=24144): stdout: | (launched: 2022-12-10_16:23:51.291968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:52.954487 run osmo-stp_10.42.42.5(pid=24144): stderr: | [0;m[38;5;43m20221210162351461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162351461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162351461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162351462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162351462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162351462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162351462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:53.095993 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24144): Process ended prematurely: osmo-stp_10.42.42.5(pid=24144) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24144)] [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:23:53.105059 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 16:23:53.132053 run osmo-hlr_10.42.42.2(pid=24141): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24141)] 16:23:53.180464 run osmo-hlr_10.42.42.2(pid=24141): stdout: | (launched: 2022-12-10_16:23:50.353178) 16:23:53.230583 run osmo-hlr_10.42.42.2(pid=24141): stderr: | [0;m[1;31m20221210162350530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162350530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162350530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162350530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162350531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162350531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162350543 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162350551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162350551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162350552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:53.300332 run osmo-msc_10.42.42.6(pid=24147): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24147)] 16:23:53.348744 run osmo-msc_10.42.42.6(pid=24147): stdout: | (launched: 2022-12-10_16:23:52.239885) 16:23:53.398696 run osmo-msc_10.42.42.6(pid=24147): stderr: | [0;m[38;5;43m20221210162352508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162352509 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc488509c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162352509 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162352509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162352509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162352509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162352511 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162352511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162352512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162352512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:53.449041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24140): Terminating (SIGTERM) 16:23:53.489275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24143): Terminating (SIGTERM) 16:23:53.529636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24146): Terminating (SIGTERM) 16:23:53.570123 --- ParallelTerminationStrategy: PID 24140 died... 16:23:53.589279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24140): Terminated: ok {rc=0} 16:23:53.634275 --- ParallelTerminationStrategy: PID 24143 died... 16:23:53.653111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24143): Terminated: ok {rc=0} 16:23:53.697658 --- ParallelTerminationStrategy: PID 24146 died... 16:23:53.716369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24146): Terminated: ok {rc=0} 16:23:53.803539 bus /sierra_3: Setting Powered False 16:23:54.904191 bus /sierra_3: Setting Powered False 16:23:56.021508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:23:57.276730 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:57.283943 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:23:57.318401 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:23:57.346818 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:23:57.399837 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:23:57.433742 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:23:57.461408 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:23:58.014014 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:23:58.065742 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:23:58.077595 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:23:58.149950 tst mo_mt_call.py: using LAC 29180 16:23:58.270262 tst mo_mt_call.py: using RAC 110 16:23:58.386726 tst mo_mt_call.py: using CellId 29180 16:23:58.502661 tst mo_mt_call.py: using BVCI 29181 16:23:58.610483 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:23:58.621757 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:23:58.632746 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:23:58.644085 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:23:58.655462 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:23:58.666820 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:23:58.780226 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:23:58.894548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:59.356540 run create_hlr_db(pid=24152): Launched 16:23:59.469773 bus /sierra_2: Setting Powered False 16:24:00.529479 run create_hlr_db(pid=24152): Terminated: ok {rc=0} 16:24:00.957401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24154): Launched 16:24:01.289695 run osmo-hlr_10.42.42.2(pid=24155): Launched 16:24:01.506963 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:02.117715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24157): Launched 16:24:02.421691 run osmo-stp_10.42.42.5(pid=24158): Launched 16:24:02.533560 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:03.069444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24160): Launched 16:24:03.367654 run osmo-msc_10.42.42.6(pid=24161): Launched 16:24:03.533666 run osmo-stp_10.42.42.5(pid=24158): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24158)] 16:24:03.659820 run osmo-stp_10.42.42.5(pid=24158): stdout: | (launched: 2022-12-10_16:24:02.366469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:03.791397 run osmo-stp_10.42.42.5(pid=24158): stderr: | [0;m[38;5;43m20221210162402537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162402537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162402537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162402538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162402540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162402540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162402540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:03.914514 run osmo-stp_10.42.42.5(pid=24158): stdout: | (launched: 2022-12-10_16:24:02.366469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:04.032249 run osmo-stp_10.42.42.5(pid=24158): stderr: | [0;m[38;5;43m20221210162402537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162402537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162402537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162402538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162402540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162402540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162402540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:04.173393 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24158): Process ended prematurely: osmo-stp_10.42.42.5(pid=24158) [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24158)] [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:24:04.182425 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:24:04.209477 run osmo-hlr_10.42.42.2(pid=24155): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24155)] 16:24:04.257976 run osmo-hlr_10.42.42.2(pid=24155): stdout: | (launched: 2022-12-10_16:24:01.221658) 16:24:04.307633 run osmo-hlr_10.42.42.2(pid=24155): stderr: | [0;m[1;31m20221210162401602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162401603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162401603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162401603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162401603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162401603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162401623 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162401636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162401637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162401637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:04.377164 run osmo-msc_10.42.42.6(pid=24161): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24161)] 16:24:04.425247 run osmo-msc_10.42.42.6(pid=24161): stdout: | (launched: 2022-12-10_16:24:03.313448) 16:24:04.474831 run osmo-msc_10.42.42.6(pid=24161): stderr: | [0;m[38;5;43m20221210162403588 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162403588 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4775c94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162403588 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162403588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162403589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162403589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162403591 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162403591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162403591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162403591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:04.524864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24154): Terminating (SIGTERM) 16:24:04.565120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24157): Terminating (SIGTERM) 16:24:04.605201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24160): Terminating (SIGTERM) 16:24:04.645504 --- ParallelTerminationStrategy: PID 24154 died... 16:24:04.664622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24154): Terminated: ok {rc=0} 16:24:04.709537 --- ParallelTerminationStrategy: PID 24157 died... 16:24:04.728111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24157): Terminated: ok {rc=0} 16:24:04.772687 --- ParallelTerminationStrategy: PID 24160 died... 16:24:04.791504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24160): Terminated: ok {rc=0} 16:24:04.875801 bus /sierra_3: Setting Powered False 16:24:05.971882 bus /sierra_3: Setting Powered False 16:24:07.087425 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:24:08.235469 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:08.247873 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:24:08.320322 tst mo_mt_call_osmux.py: using LAC 29181 16:24:08.446309 tst mo_mt_call_osmux.py: using RAC 111 16:24:08.571225 tst mo_mt_call_osmux.py: using CellId 29181 16:24:08.695575 tst mo_mt_call_osmux.py: using BVCI 29182 16:24:08.811418 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:08.822988 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:08.834488 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:08.846118 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:08.857802 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:08.869441 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:24:08.985684 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:24:09.100449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:09.557093 run create_hlr_db(pid=24163): Launched 16:24:09.670911 bus /sierra_2: Setting Powered False 16:24:10.730004 run create_hlr_db(pid=24163): Terminated: ok {rc=0} 16:24:11.142543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24165): Launched 16:24:11.441724 run osmo-hlr_10.42.42.2(pid=24166): Launched 16:24:11.566627 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:12.108214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24168): Launched 16:24:12.423280 run osmo-stp_10.42.42.5(pid=24169): Launched 16:24:12.543060 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:13.119106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24171): Launched 16:24:13.435375 run osmo-msc_10.42.42.6(pid=24172): Launched 16:24:13.611890 run osmo-stp_10.42.42.5(pid=24169): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24169)] 16:24:13.747206 run osmo-stp_10.42.42.5(pid=24169): stdout: | (launched: 2022-12-10_16:24:12.366173) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:13.881466 run osmo-stp_10.42.42.5(pid=24169): stderr: | [0;m[38;5;43m20221210162412557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162412557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162412558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162412558 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162412560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162412560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162412561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:14.015008 run osmo-stp_10.42.42.5(pid=24169): stdout: | (launched: 2022-12-10_16:24:12.366173) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:14.141442 run osmo-stp_10.42.42.5(pid=24169): stderr: | [0;m[38;5;43m20221210162412557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162412557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162412558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162412558 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162412560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162412560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162412561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:14.292557 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24169): Process ended prematurely: osmo-stp_10.42.42.5(pid=24169) [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24169)] [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:24:14.302244 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:24:14.330637 run osmo-hlr_10.42.42.2(pid=24166): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24166)] 16:24:14.381095 run osmo-hlr_10.42.42.2(pid=24166): stdout: | (launched: 2022-12-10_16:24:11.384188) 16:24:14.432941 run osmo-hlr_10.42.42.2(pid=24166): stderr: | [0;m[1;31m20221210162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162411581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162411592 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162411600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162411601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162411601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:14.505116 run osmo-msc_10.42.42.6(pid=24172): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24172)] 16:24:14.555355 run osmo-msc_10.42.42.6(pid=24172): stdout: | (launched: 2022-12-10_16:24:13.377904) 16:24:14.607123 run osmo-msc_10.42.42.6(pid=24172): stderr: | [0;m[38;5;43m20221210162413697 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162413697 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f52ee1cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162413698 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162413698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162413698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162413698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162413700 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162413700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162413700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162413700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:14.659064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24165): Terminating (SIGTERM) 16:24:14.700987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24168): Terminating (SIGTERM) 16:24:14.742989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24171): Terminating (SIGTERM) 16:24:14.785251 --- ParallelTerminationStrategy: PID 24165 died... 16:24:14.805135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24165): Terminated: ok {rc=0} 16:24:14.851127 --- ParallelTerminationStrategy: PID 24168 died... 16:24:14.870491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24168): Terminated: ok {rc=0} 16:24:14.916342 --- ParallelTerminationStrategy: PID 24171 died... 16:24:14.936046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24171): Terminated: ok {rc=0} 16:24:15.023237 bus /sierra_3: Setting Powered False 16:24:16.125775 bus /sierra_3: Setting Powered False 16:24:17.251128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:24:18.502192 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:18.508259 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:24:18.541958 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:24:18.569285 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:24:18.623266 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:24:18.656765 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:24:18.683801 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:24:19.230695 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:24:19.280182 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:19.291258 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:24:19.364867 tst mo_mt_call.py: using LAC 29182 16:24:19.493426 tst mo_mt_call.py: using RAC 112 16:24:19.617426 tst mo_mt_call.py: using CellId 29182 16:24:19.746285 tst mo_mt_call.py: using BVCI 29183 16:24:19.860937 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:19.872504 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:19.883699 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:19.894919 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:19.906058 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:19.917295 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:24:20.031051 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:24:20.143689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:20.600403 run create_hlr_db(pid=24178): Launched 16:24:20.713400 bus /sierra_2: Setting Powered False 16:24:21.772473 run create_hlr_db(pid=24178): Terminated: ok {rc=0} 16:24:22.205842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24180): Launched 16:24:22.521167 run osmo-hlr_10.42.42.2(pid=24181): Launched 16:24:22.643329 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:23.190059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24183): Launched 16:24:23.504262 run osmo-stp_10.42.42.5(pid=24184): Launched 16:24:23.625357 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:24.195085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24186): Launched 16:24:24.509738 run osmo-msc_10.42.42.6(pid=24187): Launched 16:24:24.686064 run osmo-stp_10.42.42.5(pid=24184): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24184)] 16:24:24.818959 run osmo-stp_10.42.42.5(pid=24184): stdout: | (launched: 2022-12-10_16:24:23.447159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:24.952765 run osmo-stp_10.42.42.5(pid=24184): stderr: | [0;m[38;5;43m20221210162423640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162423640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162423640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162423640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162423641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162423641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162423641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:25.086944 run osmo-stp_10.42.42.5(pid=24184): stdout: | (launched: 2022-12-10_16:24:23.447159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:25.213299 run osmo-stp_10.42.42.5(pid=24184): stderr: | [0;m[38;5;43m20221210162423640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162423640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162423640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162423640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162423641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162423641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162423641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:25.364180 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24184): Process ended prematurely: osmo-stp_10.42.42.5(pid=24184) [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24184)] [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:24:25.373699 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:24:25.401255 run osmo-hlr_10.42.42.2(pid=24181): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24181)] 16:24:25.451126 run osmo-hlr_10.42.42.2(pid=24181): stdout: | (launched: 2022-12-10_16:24:22.463959) 16:24:25.502840 run osmo-hlr_10.42.42.2(pid=24181): stderr: | [0;m[1;31m20221210162422660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162422660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162422660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162422660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162422660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162422660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162422674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162422682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162422682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162422682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:25.575457 run osmo-msc_10.42.42.6(pid=24187): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24187)] 16:24:25.625236 run osmo-msc_10.42.42.6(pid=24187): stdout: | (launched: 2022-12-10_16:24:24.452719) 16:24:25.676647 run osmo-msc_10.42.42.6(pid=24187): stderr: | [0;m[38;5;43m20221210162424774 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162424774 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2527a14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162424774 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162424774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162424774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162424775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162424777 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162424778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162424778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162424778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:25.728375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24180): Terminating (SIGTERM) 16:24:25.769853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24183): Terminating (SIGTERM) 16:24:25.811543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24186): Terminating (SIGTERM) 16:24:25.853377 --- ParallelTerminationStrategy: PID 24180 died... 16:24:25.873209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24180): Terminated: ok {rc=0} 16:24:25.919250 --- ParallelTerminationStrategy: PID 24183 died... 16:24:25.938637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24183): Terminated: ok {rc=0} 16:24:25.984592 --- ParallelTerminationStrategy: PID 24186 died... 16:24:26.004470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24186): Terminated: ok {rc=0} 16:24:26.092943 bus /sierra_3: Setting Powered False 16:24:27.189243 bus /sierra_3: Setting Powered False 16:24:28.304024 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:24:29.448173 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:29.459608 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:24:29.529656 tst mo_mt_call_osmux.py: using LAC 29183 16:24:29.656510 tst mo_mt_call_osmux.py: using RAC 113 16:24:29.782617 tst mo_mt_call_osmux.py: using CellId 29183 16:24:29.908617 tst mo_mt_call_osmux.py: using BVCI 29184 16:24:30.025622 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:30.037246 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:30.048595 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:30.060040 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:30.071469 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:30.082938 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:24:30.197106 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:24:30.315416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:30.805208 run create_hlr_db(pid=24189): Launched 16:24:30.961905 bus /sierra_2: Setting Powered False 16:24:32.040016 run create_hlr_db(pid=24189): Terminated: ok {rc=0} 16:24:32.494732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24191): Launched 16:24:32.811272 run osmo-hlr_10.42.42.2(pid=24192): Launched 16:24:32.931508 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:33.474129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24194): Launched 16:24:33.789316 run osmo-stp_10.42.42.5(pid=24195): Launched 16:24:33.909003 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:34.481753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24197): Launched 16:24:34.797734 run osmo-msc_10.42.42.6(pid=24198): Launched 16:24:34.973402 run osmo-stp_10.42.42.5(pid=24195): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24195)] 16:24:35.107097 run osmo-stp_10.42.42.5(pid=24195): stdout: | (launched: 2022-12-10_16:24:33.732006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:35.240791 run osmo-stp_10.42.42.5(pid=24195): stderr: | [0;m[38;5;43m20221210162433923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162433924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162433924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162433925 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162433925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162433925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162433925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:35.373716 run osmo-stp_10.42.42.5(pid=24195): stdout: | (launched: 2022-12-10_16:24:33.732006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:35.499995 run osmo-stp_10.42.42.5(pid=24195): stderr: | [0;m[38;5;43m20221210162433923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162433924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162433924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162433925 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162433925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162433925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162433925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:35.651733 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24195): Process ended prematurely: osmo-stp_10.42.42.5(pid=24195) [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24195)] [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:24:35.661275 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:24:35.689175 run osmo-hlr_10.42.42.2(pid=24192): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24192)] 16:24:35.739044 run osmo-hlr_10.42.42.2(pid=24192): stdout: | (launched: 2022-12-10_16:24:32.753972) 16:24:35.790758 run osmo-hlr_10.42.42.2(pid=24192): stderr: | [0;m[1;31m20221210162432952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162432952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162432952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162432952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162432952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162432952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162432965 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162432973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162432973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162432973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:35.862739 run osmo-msc_10.42.42.6(pid=24198): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24198)] 16:24:35.912520 run osmo-msc_10.42.42.6(pid=24198): stdout: | (launched: 2022-12-10_16:24:34.740165) 16:24:35.964011 run osmo-msc_10.42.42.6(pid=24198): stderr: | [0;m[38;5;43m20221210162435060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162435060 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f070c3f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162435060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162435060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162435060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162435061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162435062 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162435063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162435063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162435063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:36.016221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24191): Terminating (SIGTERM) 16:24:36.058233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24194): Terminating (SIGTERM) 16:24:36.099996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24197): Terminating (SIGTERM) 16:24:36.142172 --- ParallelTerminationStrategy: PID 24191 died... 16:24:36.161986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24191): Terminated: ok {rc=0} 16:24:36.208343 --- ParallelTerminationStrategy: PID 24194 died... 16:24:36.228121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24194): Terminated: ok {rc=0} 16:24:36.274694 --- ParallelTerminationStrategy: PID 24197 died... 16:24:36.294754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24197): Terminated: ok {rc=0} 16:24:36.383451 bus /sierra_3: Setting Powered False 16:24:37.482999 bus /sierra_3: Setting Powered False 16:24:38.600335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 emergency:trx-lms --------------------------------------------------------------------- 16:24:39.854757 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:39.859467 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 16:24:39.893089 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:24:39.920384 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 16:24:40.006403 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 16:24:40.039930 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:24:40.067273 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 16:24:40.651412 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2376 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 16:24:40.656647 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:40.667781 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 16:24:40.717634 tst emergency_mo_mt_call.py: using LAC 29184 16:24:40.840776 tst emergency_mo_mt_call.py: using RAC 114 16:24:40.963772 tst emergency_mo_mt_call.py: using CellId 29184 16:24:41.077996 tst emergency_mo_mt_call.py: using BVCI 29185 16:24:41.183344 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:41.194249 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:41.204740 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:41.215618 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:41.226494 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:41.237268 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:24:41.352866 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:24:41.468035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:41.917872 run create_hlr_db(pid=24204): Launched 16:24:42.028323 bus /sierra_2: Setting Powered False 16:24:43.090684 run create_hlr_db(pid=24204): Terminated: ok {rc=0} 16:24:43.523318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24206): Launched 16:24:43.833087 run osmo-hlr_10.42.42.2(pid=24207): Launched 16:24:43.951251 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:44.485678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24209): Launched 16:24:44.795412 run osmo-stp_10.42.42.5(pid=24210): Launched 16:24:44.922947 tst emergency_mo_mt_call.py: using MSISDN 7792 16:24:45.081111 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:45.638832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24212): Launched 16:24:45.977724 run osmo-msc_10.42.42.6(pid=24213): Launched 16:24:46.343082 run osmo-stp_10.42.42.5(pid=24210): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24210)] 16:24:46.678257 run osmo-stp_10.42.42.5(pid=24210): stdout: | (launched: 2022-12-10_16:24:44.738882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:46.942025 run osmo-stp_10.42.42.5(pid=24210): stderr: | [0;m[38;5;43m20221210162444929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162444929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162444930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162444930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162444931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162444931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162444931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:47.067765 run osmo-stp_10.42.42.5(pid=24210): stdout: | (launched: 2022-12-10_16:24:44.738882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:47.189123 run osmo-stp_10.42.42.5(pid=24210): stderr: | [0;m[38;5;43m20221210162444929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162444929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162444930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162444930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162444931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162444931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162444931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:47.333326 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24210): Process ended prematurely: osmo-stp_10.42.42.5(pid=24210) [trial-2376↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24210)] [trial-2376↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 16:24:47.342577 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 16:24:47.372355 run osmo-hlr_10.42.42.2(pid=24207): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24207)] 16:24:47.422765 run osmo-hlr_10.42.42.2(pid=24207): stdout: | (launched: 2022-12-10_16:24:43.776688) 16:24:47.474493 run osmo-hlr_10.42.42.2(pid=24207): stderr: | [0;m[1;31m20221210162443973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162443973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162443973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162443973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162443974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162443974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162443986 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162443994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162443994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162443994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:47.543793 run osmo-msc_10.42.42.6(pid=24213): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24213)] 16:24:47.592094 run osmo-msc_10.42.42.6(pid=24213): stdout: | (launched: 2022-12-10_16:24:45.905803) 16:24:47.641546 run osmo-msc_10.42.42.6(pid=24213): stderr: | [0;m[38;5;43m20221210162446416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162446417 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f594edbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162446417 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162446417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162446419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162446420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162446426 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162446427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162446429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162446429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:47.691707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24206): Terminating (SIGTERM) 16:24:47.732172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24209): Terminating (SIGTERM) 16:24:47.772567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24212): Terminating (SIGTERM) 16:24:47.813208 --- ParallelTerminationStrategy: PID 24206 died... 16:24:47.831935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24206): Terminated: ok {rc=0} 16:24:47.876630 --- ParallelTerminationStrategy: PID 24209 died... 16:24:47.895368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24209): Terminated: ok {rc=0} 16:24:47.940124 --- ParallelTerminationStrategy: PID 24212 died... 16:24:47.958896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24212): Terminated: ok {rc=0} 16:24:48.044501 bus /sierra_3: Setting Powered False 16:24:49.143978 bus /sierra_3: Setting Powered False 16:24:50.259732 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 16:24:51.345067 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:51.356889 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 16:24:51.409848 tst emergency_preemptive_call.py: using LAC 29185 16:24:51.535435 tst emergency_preemptive_call.py: using RAC 115 16:24:51.656862 tst emergency_preemptive_call.py: using CellId 29185 16:24:51.777175 tst emergency_preemptive_call.py: using BVCI 29186 16:24:51.889694 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:51.900920 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:51.911790 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:51.922763 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:51.933689 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:51.944482 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:24:52.059861 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:24:52.173662 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:24:52.290112 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:24:52.402461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:52.883653 run create_hlr_db(pid=24215): Launched 16:24:53.008874 bus /sierra_2: Setting Powered False 16:24:54.071580 run create_hlr_db(pid=24215): Terminated: ok {rc=0} 16:24:54.487395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24217): Launched 16:24:54.776912 run osmo-hlr_10.42.42.2(pid=24218): Launched 16:24:54.887470 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:55.384865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24220): Launched 16:24:55.673558 run osmo-stp_10.42.42.5(pid=24221): Launched 16:24:55.794449 tst emergency_preemptive_call.py: using MSISDN 7793 16:24:55.948233 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:56.468056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24223): Launched 16:24:56.756228 run osmo-msc_10.42.42.6(pid=24224): Launched 16:24:56.917602 run osmo-stp_10.42.42.5(pid=24221): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24221)] 16:24:57.039499 run osmo-stp_10.42.42.5(pid=24221): stdout: | (launched: 2022-12-10_16:24:55.620562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:57.162679 run osmo-stp_10.42.42.5(pid=24221): stderr: | [0;m[38;5;43m20221210162455790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162455790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162455790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162455791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162455791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162455792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162455792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:57.283680 run osmo-stp_10.42.42.5(pid=24221): stdout: | (launched: 2022-12-10_16:24:55.620562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:57.399202 run osmo-stp_10.42.42.5(pid=24221): stderr: | [0;m[38;5;43m20221210162455790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162455790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162455790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162455791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162455791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162455792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162455792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:57.537333 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24221): Process ended prematurely: osmo-stp_10.42.42.5(pid=24221) [trial-2376↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24221)] [trial-2376↪emergency:trx-lms↪emergency_preemptive_call.py:32] 16:24:57.545641 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 16:24:57.572142 run osmo-hlr_10.42.42.2(pid=24218): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24218)] 16:24:57.620658 run osmo-hlr_10.42.42.2(pid=24218): stdout: | (launched: 2022-12-10_16:24:54.723796) 16:24:57.670865 run osmo-hlr_10.42.42.2(pid=24218): stderr: | [0;m[1;31m20221210162454898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162454898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162454898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162454898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162454898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162454898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162454910 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162454918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162454918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162454918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:57.740425 run osmo-msc_10.42.42.6(pid=24224): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24224)] 16:24:57.788565 run osmo-msc_10.42.42.6(pid=24224): stdout: | (launched: 2022-12-10_16:24:56.703197) 16:24:57.838556 run osmo-msc_10.42.42.6(pid=24224): stderr: | [0;m[38;5;43m20221210162456974 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162456974 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faad855ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162456974 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162456974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162456975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162456975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162456977 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162456977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162456977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162456977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:57.888842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24217): Terminating (SIGTERM) 16:24:57.928771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24220): Terminating (SIGTERM) 16:24:57.968814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24223): Terminating (SIGTERM) 16:24:58.008778 --- ParallelTerminationStrategy: PID 24217 died... 16:24:58.028007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24217): Terminated: ok {rc=0} 16:24:58.072703 --- ParallelTerminationStrategy: PID 24220 died... 16:24:58.091663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24220): Terminated: ok {rc=0} 16:24:58.136759 --- ParallelTerminationStrategy: PID 24223 died... 16:24:58.155517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24223): Terminated: ok {rc=0} 16:24:58.242512 bus /sierra_9: Setting Powered False 16:24:59.342253 bus /sierra_9: Setting Powered False 16:25:00.457454 bus /sierra_8: Setting Powered False 16:25:01.557198 bus /sierra_8: Setting Powered False 16:25:02.691167 bus /sierra_3: Setting Powered False 16:25:03.791228 bus /sierra_3: Setting Powered False 16:25:04.909118 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-lms --------------------------------------------------------------------- 16:25:06.186939 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:25:06.191254 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 16:25:06.224696 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 16:25:06.262986 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 16:25:06.348683 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 16:25:06.381488 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 16:25:06.419558 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 16:25:07.007094 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 16:25:07.055716 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:07.066241 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:25:07.113518 tst cs_paging_gprs_active.py: using LAC 29186 16:25:07.231091 tst cs_paging_gprs_active.py: using RAC 116 16:25:07.346731 tst cs_paging_gprs_active.py: using CellId 29186 16:25:07.465528 tst cs_paging_gprs_active.py: using BVCI 29187 16:25:07.582402 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:07.593541 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:07.604197 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:07.615505 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:07.626970 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:07.638322 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:07.649778 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:07.661021 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:07.672490 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:07.786956 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:07.904499 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:25:08.120481 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:08.439051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24234): Launched 16:25:08.715898 run iperf3-srv_10.42.42.10(pid=24235): Launched 16:25:08.834375 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:25:09.048220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:09.365436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24236): Launched 16:25:09.641277 run iperf3-srv_10.42.42.10(pid=24237): Launched 16:25:09.759627 tst cs_paging_gprs_active.py:38: start network... 16:25:09.973853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:10.463743 run create_hlr_db(pid=24238): Launched 16:25:10.591072 bus /sierra_2: Setting Powered False 16:25:11.653753 run create_hlr_db(pid=24238): Terminated: ok {rc=0} 16:25:12.077582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24240): Launched 16:25:12.373694 run osmo-hlr_10.42.42.2(pid=24241): Launched 16:25:12.487008 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:13.006737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24243): Launched 16:25:13.302028 run osmo-stp_10.42.42.5(pid=24244): Launched 16:25:13.414232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:25:13.924217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24246): Launched 16:25:14.038804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:25:14.289090 run patchelf(pid=24247): Launched 16:25:14.454079 run osmo-stp_10.42.42.5(pid=24244): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24244)] 16:25:14.579783 run osmo-stp_10.42.42.5(pid=24244): stdout: | (launched: 2022-12-10_16:25:13.247927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:14.707002 run osmo-stp_10.42.42.5(pid=24244): stderr: | [0;m[38;5;43m20221210162513415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162513415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162513416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162513416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162513416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162513417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162513417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:14.835393 run osmo-stp_10.42.42.5(pid=24244): stdout: | (launched: 2022-12-10_16:25:13.247927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:14.956474 run osmo-stp_10.42.42.5(pid=24244): stderr: | [0;m[38;5;43m20221210162513415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162513415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162513416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162513416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162513416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162513417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162513417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:15.100389 run patchelf(pid=24247): Terminating (SIGINT) 16:25:15.266908 run patchelf(pid=24247): Terminated: ok {rc=0} 16:25:15.387138 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24244): Process ended prematurely: osmo-stp_10.42.42.5(pid=24244) [trial-2376↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24244)] [trial-2376↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 16:25:15.396481 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 16:25:15.424238 run osmo-hlr_10.42.42.2(pid=24241): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24241)] 16:25:15.472547 run osmo-hlr_10.42.42.2(pid=24241): stdout: | (launched: 2022-12-10_16:25:12.319885) 16:25:15.522534 run osmo-hlr_10.42.42.2(pid=24241): stderr: | [0;m[1;31m20221210162512492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162512492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162512492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162512492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162512493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162512493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162512505 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162512513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162512514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162512514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:15.572763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24234): Terminating (SIGTERM) 16:25:15.613268 run iperf3-srv_10.42.42.10(pid=24235): Terminating (SIGTERM) 16:25:15.653728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24236): Terminating (SIGTERM) 16:25:15.694209 run iperf3-srv_10.42.42.10(pid=24237): Terminating (SIGTERM) 16:25:15.734549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24240): Terminating (SIGTERM) 16:25:15.774869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24243): Terminating (SIGTERM) 16:25:15.815198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24246): Terminating (SIGTERM) 16:25:15.864290 --- ParallelTerminationStrategy: PID 24234 died... 16:25:15.885873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24234): Terminated: ok {rc=0} 16:25:15.954382 --- ParallelTerminationStrategy: PID 24235 died... 16:25:15.975439 run iperf3-srv_10.42.42.10(pid=24235): Terminated {rc=256} 16:25:16.025634 --- ParallelTerminationStrategy: PID 24236 died... 16:25:16.046810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24236): Terminated: ok {rc=0} 16:25:16.096881 --- ParallelTerminationStrategy: PID 24237 died... 16:25:16.117728 run iperf3-srv_10.42.42.10(pid=24237): Terminated {rc=256} 16:25:16.168831 --- ParallelTerminationStrategy: PID 24240 died... 16:25:16.189622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24240): Terminated: ok {rc=0} 16:25:16.237844 --- ParallelTerminationStrategy: PID 24243 died... 16:25:16.258103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24243): Terminated: ok {rc=0} 16:25:16.306554 --- ParallelTerminationStrategy: PID 24246 died... 16:25:16.327282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24246): Terminated: ok {rc=0} 16:25:16.420517 bus /gobi_0: Setting Powered False 16:25:17.520503 bus /gobi_0: Setting Powered False 16:25:18.634802 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms iperf3.py ---------------------------------------------- 16:25:19.783470 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:19.795192 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:25:19.848052 tst iperf3.py: using LAC 29187 16:25:19.973382 tst iperf3.py: using RAC 117 16:25:20.097570 tst iperf3.py: using CellId 29187 16:25:20.221286 tst iperf3.py: using BVCI 29188 16:25:20.335968 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:20.346987 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:20.357763 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:20.368444 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:20.379112 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:20.389848 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:20.400743 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:20.411509 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:20.422398 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:20.535814 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:25:20.749417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:21.066317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24248): Launched 16:25:21.341671 run iperf3-srv_10.42.42.10(pid=24249): Launched 16:25:21.460119 tst iperf3.py:8: start network... 16:25:21.673624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:22.163978 run create_hlr_db(pid=24250): Launched 16:25:22.293361 bus /gobi_6: Setting Powered False 16:25:23.356111 run create_hlr_db(pid=24250): Terminated: ok {rc=0} 16:25:23.779266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24252): Launched 16:25:24.075239 run osmo-hlr_10.42.42.2(pid=24253): Launched 16:25:24.187514 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:24.710750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24255): Launched 16:25:25.005009 run osmo-stp_10.42.42.5(pid=24256): Launched 16:25:25.117558 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:25:25.626335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24258): Launched 16:25:25.739233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:25:25.988481 run patchelf(pid=24259): Launched 16:25:26.153448 run osmo-stp_10.42.42.5(pid=24256): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24256)] 16:25:26.278858 run osmo-stp_10.42.42.5(pid=24256): stdout: | (launched: 2022-12-10_16:25:24.950987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:26.405851 run osmo-stp_10.42.42.5(pid=24256): stderr: | [0;m[38;5;43m20221210162525120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162525120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162525120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162525121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162525121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162525121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162525121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:26.533444 run osmo-stp_10.42.42.5(pid=24256): stdout: | (launched: 2022-12-10_16:25:24.950987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:26.654674 run osmo-stp_10.42.42.5(pid=24256): stderr: | [0;m[38;5;43m20221210162525120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162525120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162525120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162525121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162525121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162525121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162525121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:26.798493 run patchelf(pid=24259): Terminating (SIGINT) 16:25:26.964517 run patchelf(pid=24259): Terminated: ok {rc=0} 16:25:27.084577 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24256): Process ended prematurely: osmo-stp_10.42.42.5(pid=24256) [trial-2376↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24256)] [trial-2376↪gprs:trx-lms↪iperf3.py:8] 16:25:27.093990 tst iperf3.py:8: Test FAILED (7.3 sec) 16:25:27.121516 run osmo-hlr_10.42.42.2(pid=24253): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24253)] 16:25:27.169474 run osmo-hlr_10.42.42.2(pid=24253): stdout: | (launched: 2022-12-10_16:25:24.020861) 16:25:27.219048 run osmo-hlr_10.42.42.2(pid=24253): stderr: | [0;m[1;31m20221210162524199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162524199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162524199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162524199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162524199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162524199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162524210 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162524218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162524218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162524218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:27.269365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24248): Terminating (SIGTERM) 16:25:27.309383 run iperf3-srv_10.42.42.10(pid=24249): Terminating (SIGTERM) 16:25:27.349204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24252): Terminating (SIGTERM) 16:25:27.389020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24255): Terminating (SIGTERM) 16:25:27.428718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24258): Terminating (SIGTERM) 16:25:27.469239 --- ParallelTerminationStrategy: PID 24248 died... 16:25:27.488464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24248): Terminated: ok {rc=0} 16:25:27.533284 --- ParallelTerminationStrategy: PID 24249 died... 16:25:27.551601 run iperf3-srv_10.42.42.10(pid=24249): Terminated {rc=256} 16:25:27.596072 --- ParallelTerminationStrategy: PID 24252 died... 16:25:27.614781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24252): Terminated: ok {rc=0} 16:25:27.659034 --- ParallelTerminationStrategy: PID 24255 died... 16:25:27.677823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24255): Terminated: ok {rc=0} 16:25:27.722598 --- ParallelTerminationStrategy: PID 24258 died... 16:25:27.741475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24258): Terminated: ok {rc=0} 16:25:27.827204 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms iperf3m4.py ---------------------------------------------- 16:25:28.974002 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:28.985238 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:25:29.033406 tst iperf3m4.py: using LAC 29188 16:25:29.150822 tst iperf3m4.py: using RAC 118 16:25:29.268436 tst iperf3m4.py: using CellId 29188 16:25:29.387058 tst iperf3m4.py: using BVCI 29189 16:25:29.495516 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:29.506288 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:29.516576 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:29.527215 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:29.537753 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:29.548332 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:29.559005 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:29.569531 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:29.580326 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:29.697894 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:29.820040 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:29.933500 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:30.048244 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:25:30.247629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:30.544061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24260): Launched 16:25:30.801870 run iperf3-srv_10.42.42.10(pid=24261): Launched 16:25:30.922723 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:25:31.128511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:31.441840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24262): Launched 16:25:31.721538 run iperf3-srv_10.42.42.10(pid=24263): Launched 16:25:31.886467 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:25:32.109365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:32.421162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24264): Launched 16:25:32.678866 run iperf3-srv_10.42.42.10(pid=24265): Launched 16:25:32.789605 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:25:32.987212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:33.284205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24266): Launched 16:25:33.542089 run iperf3-srv_10.42.42.10(pid=24267): Launched 16:25:33.652842 tst iperf3m4.py:8: start network... 16:25:33.851589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:34.308655 run create_hlr_db(pid=24268): Launched 16:25:34.421191 bus /gobi_6: Setting Powered False 16:25:35.480819 run create_hlr_db(pid=24268): Terminated: ok {rc=0} 16:25:35.913497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24270): Launched 16:25:36.231834 run osmo-hlr_10.42.42.2(pid=24271): Launched 16:25:36.352449 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:36.900523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24273): Launched 16:25:37.216671 run osmo-stp_10.42.42.5(pid=24274): Launched 16:25:37.337039 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:25:37.881428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24276): Launched 16:25:38.002347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:25:38.270234 run patchelf(pid=24277): Launched 16:25:38.445448 run osmo-stp_10.42.42.5(pid=24274): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24274)] 16:25:38.579529 run osmo-stp_10.42.42.5(pid=24274): stdout: | (launched: 2022-12-10_16:25:37.159327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:38.715780 run osmo-stp_10.42.42.5(pid=24274): stderr: | [0;m[38;5;43m20221210162537347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162537347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162537347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162537347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162537348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162537348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162537348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:38.851803 run osmo-stp_10.42.42.5(pid=24274): stdout: | (launched: 2022-12-10_16:25:37.159327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:38.981534 run osmo-stp_10.42.42.5(pid=24274): stderr: | [0;m[38;5;43m20221210162537347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162537347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162537347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162537347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162537348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162537348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162537348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:39.135174 run patchelf(pid=24277): Terminating (SIGINT) 16:25:39.312471 run patchelf(pid=24277): Terminated: ok {rc=0} 16:25:39.440693 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24274): Process ended prematurely: osmo-stp_10.42.42.5(pid=24274) [trial-2376↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24274)] [trial-2376↪gprs:trx-lms↪iperf3m4.py:8] 16:25:39.450716 tst iperf3m4.py:8: Test FAILED (10.5 sec) 16:25:39.479317 run osmo-hlr_10.42.42.2(pid=24271): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24271)] 16:25:39.529422 run osmo-hlr_10.42.42.2(pid=24271): stdout: | (launched: 2022-12-10_16:25:36.174131) 16:25:39.580916 run osmo-hlr_10.42.42.2(pid=24271): stderr: | [0;m[1;31m20221210162536370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162536370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162536370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162536370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162536370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162536370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162536382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162536390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162536391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162536391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:39.633126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24260): Terminating (SIGTERM) 16:25:39.674822 run iperf3-srv_10.42.42.10(pid=24261): Terminating (SIGTERM) 16:25:39.716544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24262): Terminating (SIGTERM) 16:25:39.758443 run iperf3-srv_10.42.42.10(pid=24263): Terminating (SIGTERM) 16:25:39.800200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24264): Terminating (SIGTERM) 16:25:39.842219 run iperf3-srv_10.42.42.10(pid=24265): Terminating (SIGTERM) 16:25:39.885414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24266): Terminating (SIGTERM) 16:25:39.931061 run iperf3-srv_10.42.42.10(pid=24267): Terminating (SIGTERM) 16:25:39.976693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24270): Terminating (SIGTERM) 16:25:40.018923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24273): Terminating (SIGTERM) 16:25:40.061077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24276): Terminating (SIGTERM) 16:25:40.103299 --- ParallelTerminationStrategy: PID 24260 died... 16:25:40.123316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24260): Terminated: ok {rc=0} 16:25:40.170070 --- ParallelTerminationStrategy: PID 24261 died... 16:25:40.189671 run iperf3-srv_10.42.42.10(pid=24261): Terminated {rc=256} 16:25:40.235801 --- ParallelTerminationStrategy: PID 24262 died... 16:25:40.255302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24262): Terminated: ok {rc=0} 16:25:40.301356 --- ParallelTerminationStrategy: PID 24263 died... 16:25:40.320834 run iperf3-srv_10.42.42.10(pid=24263): Terminated {rc=256} 16:25:40.366924 --- ParallelTerminationStrategy: PID 24264 died... 16:25:40.386395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24264): Terminated: ok {rc=0} 16:25:40.432430 --- ParallelTerminationStrategy: PID 24265 died... 16:25:40.451904 run iperf3-srv_10.42.42.10(pid=24265): Terminated {rc=256} 16:25:40.498488 --- ParallelTerminationStrategy: PID 24266 died... 16:25:40.518047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24266): Terminated: ok {rc=0} 16:25:40.564080 --- ParallelTerminationStrategy: PID 24267 died... 16:25:40.583558 run iperf3-srv_10.42.42.10(pid=24267): Terminated {rc=256} 16:25:40.629818 --- ParallelTerminationStrategy: PID 24270 died... 16:25:40.649452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24270): Terminated: ok {rc=0} 16:25:40.695470 --- ParallelTerminationStrategy: PID 24273 died... 16:25:40.715051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24273): Terminated: ok {rc=0} 16:25:40.761410 --- ParallelTerminationStrategy: PID 24276 died... 16:25:40.780848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24276): Terminated: ok {rc=0} 16:25:40.868662 bus /gobi_4: Setting Powered False 16:25:41.966677 bus /gobi_4: Setting Powered False 16:25:43.081700 bus /gobi_1: Setting Powered False 16:25:44.178135 bus /gobi_1: Setting Powered False 16:25:45.293301 bus /gobi_0: Setting Powered False 16:25:46.398799 bus /gobi_0: Setting Powered False 16:25:47.516299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms ping.py ---------------------------------------------- 16:25:48.620658 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:48.631810 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:25:48.697957 tst ping.py: using LAC 29189 16:25:48.815422 tst ping.py: using RAC 119 16:25:48.927968 tst ping.py: using CellId 29189 16:25:49.039892 tst ping.py: using BVCI 29190 16:25:49.145186 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:49.155660 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:49.166032 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:49.176551 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:49.187139 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:49.197649 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:49.208224 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:49.218879 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:49.334819 tst ping.py:19: start network... 16:25:49.529536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:49.978975 run create_hlr_db(pid=24278): Launched 16:25:50.088937 bus /gobi_6: Setting Powered False 16:25:51.152598 run create_hlr_db(pid=24278): Terminated: ok {rc=0} 16:25:51.569535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24280): Launched 16:25:51.881079 run osmo-hlr_10.42.42.2(pid=24281): Launched 16:25:51.998746 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:52.538689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24283): Launched 16:25:52.848912 run osmo-stp_10.42.42.5(pid=24284): Launched 16:25:52.966645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:25:53.502419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24286): Launched 16:25:53.620781 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:25:53.883273 run patchelf(pid=24287): Launched 16:25:54.056777 run osmo-stp_10.42.42.5(pid=24284): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24284)] 16:25:54.189046 run osmo-stp_10.42.42.5(pid=24284): stdout: | (launched: 2022-12-10_16:25:52.792342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:54.323049 run osmo-stp_10.42.42.5(pid=24284): stderr: | [0;m[38;5;43m20221210162552981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162552982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162552982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162552982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162552983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162552983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162552983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:54.456403 run osmo-stp_10.42.42.5(pid=24284): stdout: | (launched: 2022-12-10_16:25:52.792342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:54.584208 run osmo-stp_10.42.42.5(pid=24284): stderr: | [0;m[38;5;43m20221210162552981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162552982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162552982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162552982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162552983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162552983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162552983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:54.735590 run patchelf(pid=24287): Terminating (SIGINT) 16:25:54.909955 run patchelf(pid=24287): Terminated: ok {rc=0} 16:25:55.035289 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24284): Process ended prematurely: osmo-stp_10.42.42.5(pid=24284) [trial-2376↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24284)] [trial-2376↪gprs:trx-lms↪ping.py:22] 16:25:55.045029 tst ping.py:22: Test FAILED (6.4 sec) 16:25:55.073083 run osmo-hlr_10.42.42.2(pid=24281): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24281)] 16:25:55.123305 run osmo-hlr_10.42.42.2(pid=24281): stdout: | (launched: 2022-12-10_16:25:51.824242) 16:25:55.175175 run osmo-hlr_10.42.42.2(pid=24281): stderr: | [0;m[1;31m20221210162552020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162552020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162552020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162552020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162552020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162552020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162552038 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162552049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162552050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162552050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:55.227580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24280): Terminating (SIGTERM) 16:25:55.269539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24283): Terminating (SIGTERM) 16:25:55.311556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24286): Terminating (SIGTERM) 16:25:55.353989 --- ParallelTerminationStrategy: PID 24280 died... 16:25:55.374260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24280): Terminated: ok {rc=0} 16:25:55.421311 --- ParallelTerminationStrategy: PID 24283 died... 16:25:55.440924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24283): Terminated: ok {rc=0} 16:25:55.487463 --- ParallelTerminationStrategy: PID 24286 died... 16:25:55.507003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24286): Terminated: ok {rc=0} 16:25:55.595406 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 16:25:56.684124 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:56.696115 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:25:56.750307 tst ping_idle_ping.py: using LAC 29190 16:25:56.872519 tst ping_idle_ping.py: using RAC 120 16:25:56.993131 tst ping_idle_ping.py: using CellId 29190 16:25:57.114264 tst ping_idle_ping.py: using BVCI 29191 16:25:57.227094 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:57.238175 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:57.249051 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:57.259875 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:57.270724 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:57.281525 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:57.292439 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:57.303316 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:57.418881 tst ping_idle_ping.py:24: start network... 16:25:57.628843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:58.113646 run create_hlr_db(pid=24288): Launched 16:25:58.241494 bus /gobi_6: Setting Powered False 16:25:59.303723 run create_hlr_db(pid=24288): Terminated: ok {rc=0} 16:25:59.723339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24290): Launched 16:26:00.016400 run osmo-hlr_10.42.42.2(pid=24291): Launched 16:26:00.128146 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:00.642975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24293): Launched 16:26:00.961723 run osmo-stp_10.42.42.5(pid=24294): Launched 16:26:01.272665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:26:01.949980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24296): Launched 16:26:02.071873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:26:02.339193 run patchelf(pid=24297): Launched 16:26:02.512493 run osmo-stp_10.42.42.5(pid=24294): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24294)] 16:26:02.644595 run osmo-stp_10.42.42.5(pid=24294): stdout: | (launched: 2022-12-10_16:26:00.894978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:02.778210 run osmo-stp_10.42.42.5(pid=24294): stderr: | [0;m[38;5;43m20221210162601186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162601186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162601187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162601189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162601194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162601194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162601195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:02.911874 run osmo-stp_10.42.42.5(pid=24294): stdout: | (launched: 2022-12-10_16:26:00.894978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:03.039542 run osmo-stp_10.42.42.5(pid=24294): stderr: | [0;m[38;5;43m20221210162601186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162601186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162601187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162601189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162601194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162601194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162601195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:03.191293 run patchelf(pid=24297): Terminating (SIGINT) 16:26:03.365171 run patchelf(pid=24297): Terminated: ok {rc=0} 16:26:03.490564 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24294): Process ended prematurely: osmo-stp_10.42.42.5(pid=24294) [trial-2376↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24294)] [trial-2376↪gprs:trx-lms↪ping_idle_ping.py:27] 16:26:03.499971 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:26:03.528178 run osmo-hlr_10.42.42.2(pid=24291): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24291)] 16:26:03.578354 run osmo-hlr_10.42.42.2(pid=24291): stdout: | (launched: 2022-12-10_16:25:59.962920) 16:26:03.630338 run osmo-hlr_10.42.42.2(pid=24291): stderr: | [0;m[1;31m20221210162600139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162600140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162600140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162600140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162600140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162600140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162600152 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162600160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162600161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162600161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:03.682593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24290): Terminating (SIGTERM) 16:26:03.724758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24293): Terminating (SIGTERM) 16:26:03.766997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24296): Terminating (SIGTERM) 16:26:03.809513 --- ParallelTerminationStrategy: PID 24290 died... 16:26:03.829817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24290): Terminated: ok {rc=0} 16:26:03.876860 --- ParallelTerminationStrategy: PID 24293 died... 16:26:03.896784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24293): Terminated: ok {rc=0} 16:26:03.943244 --- ParallelTerminationStrategy: PID 24296 died... 16:26:03.963016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24296): Terminated: ok {rc=0} 16:26:04.051367 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 16:26:05.353396 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:26:05.359092 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:26:05.392936 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:26:05.432287 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:26:05.521990 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:26:05.556121 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:26:05.595339 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:26:06.191256 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:26:06.243873 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:06.255047 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:26:06.305222 tst cs_paging_gprs_active.py: using LAC 29191 16:26:06.428762 tst cs_paging_gprs_active.py: using RAC 121 16:26:06.551929 tst cs_paging_gprs_active.py: using CellId 29191 16:26:06.675146 tst cs_paging_gprs_active.py: using BVCI 29192 16:26:06.790491 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:06.801850 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:06.812840 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:06.823966 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:06.834935 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:06.845904 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:06.857061 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:06.867914 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:06.879138 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:06.994972 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:07.113298 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:26:07.329015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:07.648179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24301): Launched 16:26:07.924371 run iperf3-srv_10.42.42.10(pid=24302): Launched 16:26:08.043215 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:26:08.257938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:08.577675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24303): Launched 16:26:08.853535 run iperf3-srv_10.42.42.10(pid=24304): Launched 16:26:08.972517 tst cs_paging_gprs_active.py:38: start network... 16:26:09.188133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:09.680806 run create_hlr_db(pid=24305): Launched 16:26:09.809045 bus /gobi_6: Setting Powered False 16:26:10.872400 run create_hlr_db(pid=24305): Terminated: ok {rc=0} 16:26:11.315233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24307): Launched 16:26:11.631100 run osmo-hlr_10.42.42.2(pid=24308): Launched 16:26:11.751203 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:12.295509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24310): Launched 16:26:12.611780 run osmo-stp_10.42.42.5(pid=24311): Launched 16:26:12.731504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:26:13.278186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24313): Launched 16:26:13.399308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:26:13.667370 run patchelf(pid=24314): Launched 16:26:13.845217 run osmo-stp_10.42.42.5(pid=24311): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24311)] 16:26:13.979618 run osmo-stp_10.42.42.5(pid=24311): stdout: | (launched: 2022-12-10_16:26:12.554128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:14.116920 run osmo-stp_10.42.42.5(pid=24311): stderr: | [0;m[38;5;43m20221210162612744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162612744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162612745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162612745 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162612746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162612746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162612746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:14.253601 run osmo-stp_10.42.42.5(pid=24311): stdout: | (launched: 2022-12-10_16:26:12.554128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:14.383925 run osmo-stp_10.42.42.5(pid=24311): stderr: | [0;m[38;5;43m20221210162612744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162612744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162612745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162612745 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162612746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162612746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162612746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:14.539556 run patchelf(pid=24314): Terminating (SIGINT) 16:26:14.717807 run patchelf(pid=24314): Terminated: ok {rc=0} 16:26:14.846254 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24311): Process ended prematurely: osmo-stp_10.42.42.5(pid=24311) [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24311)] [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:26:14.856302 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:26:14.884881 run osmo-hlr_10.42.42.2(pid=24308): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24308)] 16:26:14.934995 run osmo-hlr_10.42.42.2(pid=24308): stdout: | (launched: 2022-12-10_16:26:11.573563) 16:26:14.986945 run osmo-hlr_10.42.42.2(pid=24308): stderr: | [0;m[1;31m20221210162611771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162611771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162611771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162611771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162611771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162611771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162611784 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162611793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162611793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162611793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:15.039514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24301): Terminating (SIGTERM) 16:26:15.081996 run iperf3-srv_10.42.42.10(pid=24302): Terminating (SIGTERM) 16:26:15.124002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24303): Terminating (SIGTERM) 16:26:15.166092 run iperf3-srv_10.42.42.10(pid=24304): Terminating (SIGTERM) 16:26:15.207953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24307): Terminating (SIGTERM) 16:26:15.249931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24310): Terminating (SIGTERM) 16:26:15.291948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24313): Terminating (SIGTERM) 16:26:15.334245 --- ParallelTerminationStrategy: PID 24301 died... 16:26:15.354406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24301): Terminated: ok {rc=0} 16:26:15.400856 --- ParallelTerminationStrategy: PID 24302 died... 16:26:15.420463 run iperf3-srv_10.42.42.10(pid=24302): Terminated {rc=256} 16:26:15.466718 --- ParallelTerminationStrategy: PID 24303 died... 16:26:15.486395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24303): Terminated: ok {rc=0} 16:26:15.532631 --- ParallelTerminationStrategy: PID 24304 died... 16:26:15.552195 run iperf3-srv_10.42.42.10(pid=24304): Terminated {rc=256} 16:26:15.598453 --- ParallelTerminationStrategy: PID 24307 died... 16:26:15.618119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24307): Terminated: ok {rc=0} 16:26:15.664591 --- ParallelTerminationStrategy: PID 24310 died... 16:26:15.684328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24310): Terminated: ok {rc=0} 16:26:15.730896 --- ParallelTerminationStrategy: PID 24313 died... 16:26:15.750657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24313): Terminated: ok {rc=0} 16:26:15.848303 bus /gobi_0: Setting Powered False 16:26:16.971040 bus /gobi_0: Setting Powered False 16:26:18.084787 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:26:19.232561 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:19.244437 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:26:19.297153 tst iperf3.py: using LAC 29192 16:26:19.422567 tst iperf3.py: using RAC 122 16:26:19.548648 tst iperf3.py: using CellId 29192 16:26:19.674434 tst iperf3.py: using BVCI 29193 16:26:19.789404 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:19.801119 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:19.812084 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:19.823248 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:19.834309 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:19.845270 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:19.856315 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:19.867243 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:19.878402 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:19.995429 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:26:20.210100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:20.529075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24315): Launched 16:26:20.804240 run iperf3-srv_10.42.42.10(pid=24316): Launched 16:26:20.922894 tst iperf3.py:8: start network... 16:26:21.137247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:21.627238 run create_hlr_db(pid=24317): Launched 16:26:21.754503 bus /gobi_6: Setting Powered False 16:26:22.818104 run create_hlr_db(pid=24317): Terminated: ok {rc=0} 16:26:23.243828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24319): Launched 16:26:23.541090 run osmo-hlr_10.42.42.2(pid=24320): Launched 16:26:23.654927 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:24.182682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24322): Launched 16:26:24.478467 run osmo-stp_10.42.42.5(pid=24323): Launched 16:26:24.592211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:26:25.102020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24325): Launched 16:26:25.215199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:26:25.464878 run patchelf(pid=24326): Launched 16:26:25.629681 run osmo-stp_10.42.42.5(pid=24323): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24323)] 16:26:25.755894 run osmo-stp_10.42.42.5(pid=24323): stdout: | (launched: 2022-12-10_16:26:24.424130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:25.883632 run osmo-stp_10.42.42.5(pid=24323): stderr: | [0;m[38;5;43m20221210162624593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162624593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162624593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162624593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162624594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162624594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162624594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:26.011270 run osmo-stp_10.42.42.5(pid=24323): stdout: | (launched: 2022-12-10_16:26:24.424130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:26.133301 run osmo-stp_10.42.42.5(pid=24323): stderr: | [0;m[38;5;43m20221210162624593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162624593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162624593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162624593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162624594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162624594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162624594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:26.277821 run patchelf(pid=24326): Terminating (SIGINT) 16:26:26.444755 run patchelf(pid=24326): Terminated: ok {rc=0} 16:26:26.566000 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24323): Process ended prematurely: osmo-stp_10.42.42.5(pid=24323) [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24323)] [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 16:26:26.575243 tst iperf3.py:8: Test FAILED (7.4 sec) 16:26:26.602968 run osmo-hlr_10.42.42.2(pid=24320): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24320)] 16:26:26.650918 run osmo-hlr_10.42.42.2(pid=24320): stdout: | (launched: 2022-12-10_16:26:23.486414) 16:26:26.700192 run osmo-hlr_10.42.42.2(pid=24320): stderr: | [0;m[1;31m20221210162623659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162623659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162623659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162623659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162623659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162623659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162623671 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162623680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162623680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162623680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:26.750208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24315): Terminating (SIGTERM) 16:26:26.790707 run iperf3-srv_10.42.42.10(pid=24316): Terminating (SIGTERM) 16:26:26.830577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24319): Terminating (SIGTERM) 16:26:26.870350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24322): Terminating (SIGTERM) 16:26:26.910257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24325): Terminating (SIGTERM) 16:26:26.950233 --- ParallelTerminationStrategy: PID 24315 died... 16:26:26.969346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24315): Terminated: ok {rc=0} 16:26:27.014244 --- ParallelTerminationStrategy: PID 24316 died... 16:26:27.032830 run iperf3-srv_10.42.42.10(pid=24316): Terminated {rc=256} 16:26:27.077406 --- ParallelTerminationStrategy: PID 24319 died... 16:26:27.096140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24319): Terminated: ok {rc=0} 16:26:27.140427 --- ParallelTerminationStrategy: PID 24322 died... 16:26:27.159062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24322): Terminated: ok {rc=0} 16:26:27.203630 --- ParallelTerminationStrategy: PID 24325 died... 16:26:27.222371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24325): Terminated: ok {rc=0} 16:26:27.308347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:26:28.454942 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:28.466412 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:26:28.517231 tst iperf3m4.py: using LAC 29193 16:26:28.635287 tst iperf3m4.py: using RAC 123 16:26:28.751469 tst iperf3m4.py: using CellId 29193 16:26:28.869402 tst iperf3m4.py: using BVCI 29194 16:26:28.978111 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:28.988916 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:28.999589 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:29.010496 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:29.021398 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:29.032130 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:29.043403 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:29.054307 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:29.065556 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:29.179573 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:29.299189 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:29.416232 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:29.536643 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:26:29.752524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:30.071053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24327): Launched 16:26:30.347271 run iperf3-srv_10.42.42.10(pid=24328): Launched 16:26:30.466106 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:26:30.680510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:31.026843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24329): Launched 16:26:31.324594 run iperf3-srv_10.42.42.10(pid=24330): Launched 16:26:31.459079 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:26:31.677419 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:32.007436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24331): Launched 16:26:32.286019 run iperf3-srv_10.42.42.10(pid=24332): Launched 16:26:32.397174 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:26:32.596708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:32.894490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24333): Launched 16:26:33.152003 run iperf3-srv_10.42.42.10(pid=24334): Launched 16:26:33.262663 tst iperf3m4.py:8: start network... 16:26:33.460695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:33.918422 run create_hlr_db(pid=24335): Launched 16:26:34.031560 bus /gobi_6: Setting Powered False 16:26:35.091938 run create_hlr_db(pid=24335): Terminated: ok {rc=0} 16:26:35.526446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24337): Launched 16:26:35.844094 run osmo-hlr_10.42.42.2(pid=24338): Launched 16:26:35.964549 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:36.514435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24340): Launched 16:26:36.830200 run osmo-stp_10.42.42.5(pid=24341): Launched 16:26:36.950274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:26:37.494454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24343): Launched 16:26:37.614818 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:26:37.880927 run patchelf(pid=24344): Launched 16:26:38.056219 run osmo-stp_10.42.42.5(pid=24341): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24341)] 16:26:38.190807 run osmo-stp_10.42.42.5(pid=24341): stdout: | (launched: 2022-12-10_16:26:36.772585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:38.326986 run osmo-stp_10.42.42.5(pid=24341): stderr: | [0;m[38;5;43m20221210162636959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162636959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162636959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162636960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162636960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162636960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162636960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:38.462960 run osmo-stp_10.42.42.5(pid=24341): stdout: | (launched: 2022-12-10_16:26:36.772585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:38.592427 run osmo-stp_10.42.42.5(pid=24341): stderr: | [0;m[38;5;43m20221210162636959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162636959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162636959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162636960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162636960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162636960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162636960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:38.747022 run patchelf(pid=24344): Terminating (SIGINT) 16:26:38.924143 run patchelf(pid=24344): Terminated: ok {rc=0} 16:26:39.051920 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24341): Process ended prematurely: osmo-stp_10.42.42.5(pid=24341) [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24341)] [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 16:26:39.061879 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:26:39.090968 run osmo-hlr_10.42.42.2(pid=24338): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24338)] 16:26:39.141076 run osmo-hlr_10.42.42.2(pid=24338): stdout: | (launched: 2022-12-10_16:26:35.785662) 16:26:39.192569 run osmo-hlr_10.42.42.2(pid=24338): stderr: | [0;m[1;31m20221210162635981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162635981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162635981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162635981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162635981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162635981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162635993 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162636001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162636001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162636001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:39.244542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24327): Terminating (SIGTERM) 16:26:39.286109 run iperf3-srv_10.42.42.10(pid=24328): Terminating (SIGTERM) 16:26:39.327689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24329): Terminating (SIGTERM) 16:26:39.369597 run iperf3-srv_10.42.42.10(pid=24330): Terminating (SIGTERM) 16:26:39.411194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24331): Terminating (SIGTERM) 16:26:39.452922 run iperf3-srv_10.42.42.10(pid=24332): Terminating (SIGTERM) 16:26:39.494642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24333): Terminating (SIGTERM) 16:26:39.536396 run iperf3-srv_10.42.42.10(pid=24334): Terminating (SIGTERM) 16:26:39.578081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24337): Terminating (SIGTERM) 16:26:39.619739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24340): Terminating (SIGTERM) 16:26:39.661338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24343): Terminating (SIGTERM) 16:26:39.703332 --- ParallelTerminationStrategy: PID 24327 died... 16:26:39.723418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24327): Terminated: ok {rc=0} 16:26:39.769870 --- ParallelTerminationStrategy: PID 24328 died... 16:26:39.789390 run iperf3-srv_10.42.42.10(pid=24328): Terminated {rc=256} 16:26:39.835551 --- ParallelTerminationStrategy: PID 24329 died... 16:26:39.855153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24329): Terminated: ok {rc=0} 16:26:39.901236 --- ParallelTerminationStrategy: PID 24330 died... 16:26:39.920473 run iperf3-srv_10.42.42.10(pid=24330): Terminated {rc=256} 16:26:39.966723 --- ParallelTerminationStrategy: PID 24331 died... 16:26:39.986183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24331): Terminated: ok {rc=0} 16:26:40.032066 --- ParallelTerminationStrategy: PID 24332 died... 16:26:40.051866 run iperf3-srv_10.42.42.10(pid=24332): Terminated {rc=256} 16:26:40.098675 --- ParallelTerminationStrategy: PID 24333 died... 16:26:40.118235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24333): Terminated: ok {rc=0} 16:26:40.164072 --- ParallelTerminationStrategy: PID 24334 died... 16:26:40.183556 run iperf3-srv_10.42.42.10(pid=24334): Terminated {rc=256} 16:26:40.229342 --- ParallelTerminationStrategy: PID 24337 died... 16:26:40.248927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24337): Terminated: ok {rc=0} 16:26:40.294801 --- ParallelTerminationStrategy: PID 24340 died... 16:26:40.314372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24340): Terminated: ok {rc=0} 16:26:40.360535 --- ParallelTerminationStrategy: PID 24343 died... 16:26:40.380199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24343): Terminated: ok {rc=0} 16:26:40.467646 bus /gobi_4: Setting Powered False 16:26:41.567473 bus /gobi_4: Setting Powered False 16:26:42.685239 bus /gobi_1: Setting Powered False 16:26:43.781736 bus /gobi_1: Setting Powered False 16:26:44.895070 bus /gobi_0: Setting Powered False 16:26:46.003700 bus /gobi_0: Setting Powered False 16:26:47.141781 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 16:26:48.245517 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:48.256814 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:26:48.306780 tst ping.py: using LAC 29194 16:26:48.422987 tst ping.py: using RAC 124 16:26:48.536929 tst ping.py: using CellId 29194 16:26:48.653355 tst ping.py: using BVCI 29195 16:26:48.759687 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:48.770616 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:48.781240 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:48.792094 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:48.802920 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:48.813809 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:48.824774 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:48.835776 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:48.949827 tst ping.py:19: start network... 16:26:49.144386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:49.592754 run create_hlr_db(pid=24345): Launched 16:26:49.702761 bus /gobi_6: Setting Powered False 16:26:50.761852 run create_hlr_db(pid=24345): Terminated: ok {rc=0} 16:26:51.188436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24347): Launched 16:26:51.499024 run osmo-hlr_10.42.42.2(pid=24348): Launched 16:26:51.617977 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:52.161859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24350): Launched 16:26:52.471890 run osmo-stp_10.42.42.5(pid=24351): Launched 16:26:52.590993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:26:53.130372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24353): Launched 16:26:53.248648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:26:53.511123 run patchelf(pid=24354): Launched 16:26:53.683841 run osmo-stp_10.42.42.5(pid=24351): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24351)] 16:26:53.815846 run osmo-stp_10.42.42.5(pid=24351): stdout: | (launched: 2022-12-10_16:26:52.415148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:53.949231 run osmo-stp_10.42.42.5(pid=24351): stderr: | [0;m[38;5;43m20221210162652605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162652605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162652605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162652606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162652608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162652608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162652608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:54.083381 run osmo-stp_10.42.42.5(pid=24351): stdout: | (launched: 2022-12-10_16:26:52.415148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:54.211155 run osmo-stp_10.42.42.5(pid=24351): stderr: | [0;m[38;5;43m20221210162652605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162652605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162652605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162652606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162652608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162652608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162652608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:54.362765 run patchelf(pid=24354): Terminating (SIGINT) 16:26:54.537347 run patchelf(pid=24354): Terminated: ok {rc=0} 16:26:54.662962 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24351): Process ended prematurely: osmo-stp_10.42.42.5(pid=24351) [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24351)] [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 16:26:54.672199 tst ping.py:22: Test FAILED (6.4 sec) 16:26:54.700394 run osmo-hlr_10.42.42.2(pid=24348): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24348)] 16:26:54.751102 run osmo-hlr_10.42.42.2(pid=24348): stdout: | (launched: 2022-12-10_16:26:51.442288) 16:26:54.803103 run osmo-hlr_10.42.42.2(pid=24348): stderr: | [0;m[1;31m20221210162651637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162651637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162651637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162651637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162651638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162651638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162651650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162651658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162651659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162651659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:54.855304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24347): Terminating (SIGTERM) 16:26:54.897266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24350): Terminating (SIGTERM) 16:26:54.939196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24353): Terminating (SIGTERM) 16:26:54.981609 --- ParallelTerminationStrategy: PID 24347 died... 16:26:55.001746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24347): Terminated: ok {rc=0} 16:26:55.048448 --- ParallelTerminationStrategy: PID 24350 died... 16:26:55.068264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24350): Terminated: ok {rc=0} 16:26:55.115068 --- ParallelTerminationStrategy: PID 24353 died... 16:26:55.134986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24353): Terminated: ok {rc=0} 16:26:55.223015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:26:56.311600 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:56.323826 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:26:56.376579 tst ping_idle_ping.py: using LAC 29195 16:26:56.500170 tst ping_idle_ping.py: using RAC 125 16:26:56.622402 tst ping_idle_ping.py: using CellId 29195 16:26:56.745989 tst ping_idle_ping.py: using BVCI 29196 16:26:56.859427 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:56.870785 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:56.881868 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:56.892942 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:56.904015 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:56.915149 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:56.926476 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:56.937596 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:57.054133 tst ping_idle_ping.py:24: start network... 16:26:57.264353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:57.748003 run create_hlr_db(pid=24355): Launched 16:26:57.873613 bus /gobi_6: Setting Powered False 16:26:58.935684 run create_hlr_db(pid=24355): Terminated: ok {rc=0} 16:26:59.355283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24357): Launched 16:26:59.645703 run osmo-hlr_10.42.42.2(pid=24358): Launched 16:26:59.758116 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:00.260926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24360): Launched 16:27:00.553047 run osmo-stp_10.42.42.5(pid=24361): Launched 16:27:00.665601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:01.265183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24363): Launched 16:27:01.432175 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:01.751902 run patchelf(pid=24364): Launched 16:27:01.935687 run osmo-stp_10.42.42.5(pid=24361): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24361)] 16:27:02.062480 run osmo-stp_10.42.42.5(pid=24361): stdout: | (launched: 2022-12-10_16:27:00.499306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:02.191414 run osmo-stp_10.42.42.5(pid=24361): stderr: | [0;m[38;5;43m20221210162700667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162700667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162700667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162700668 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162700668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162700668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162700668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:02.320016 run osmo-stp_10.42.42.5(pid=24361): stdout: | (launched: 2022-12-10_16:27:00.499306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:02.440546 run osmo-stp_10.42.42.5(pid=24361): stderr: | [0;m[38;5;43m20221210162700667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162700667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162700667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162700668 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162700668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162700668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162700668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:02.582005 run patchelf(pid=24364): Terminating (SIGINT) 16:27:02.746155 run patchelf(pid=24364): Terminated: ok {rc=0} 16:27:02.864757 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24361): Process ended prematurely: osmo-stp_10.42.42.5(pid=24361) [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24361)] [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 16:27:02.873979 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:27:02.901112 run osmo-hlr_10.42.42.2(pid=24358): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24358)] 16:27:02.949354 run osmo-hlr_10.42.42.2(pid=24358): stdout: | (launched: 2022-12-10_16:26:59.592442) 16:27:02.998923 run osmo-hlr_10.42.42.2(pid=24358): stderr: | [0;m[1;31m20221210162659765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162659765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162659765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162659765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162659765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162659765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162659777 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162659786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162659786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162659786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:03.049147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24357): Terminating (SIGTERM) 16:27:03.089280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24360): Terminating (SIGTERM) 16:27:03.129517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24363): Terminating (SIGTERM) 16:27:03.170324 --- ParallelTerminationStrategy: PID 24357 died... 16:27:03.189766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24357): Terminated: ok {rc=0} 16:27:03.234983 --- ParallelTerminationStrategy: PID 24360 died... 16:27:03.254060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24360): Terminated: ok {rc=0} 16:27:03.299237 --- ParallelTerminationStrategy: PID 24363 died... 16:27:03.318346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24363): Terminated: ok {rc=0} 16:27:03.403882 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:27:04.700109 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:27:04.705980 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:27:04.739162 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:27:04.777290 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:27:04.862547 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:27:04.895151 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:27:04.933100 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:27:05.526168 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:27:05.574565 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:05.585380 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:27:05.652368 tst cs_paging_gprs_active.py: using LAC 29196 16:27:05.768836 tst cs_paging_gprs_active.py: using RAC 126 16:27:05.884904 tst cs_paging_gprs_active.py: using CellId 29196 16:27:06.001352 tst cs_paging_gprs_active.py: using BVCI 29197 16:27:06.108765 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:06.119706 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:06.130373 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:06.141399 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:06.152099 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:06.163066 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:06.174105 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:06.184768 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:06.195788 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:06.314298 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:06.430021 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:27:06.630196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:06.929077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24368): Launched 16:27:07.187371 run iperf3-srv_10.42.42.10(pid=24369): Launched 16:27:07.298118 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:27:07.497385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:07.795281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24370): Launched 16:27:08.053178 run iperf3-srv_10.42.42.10(pid=24371): Launched 16:27:08.164225 tst cs_paging_gprs_active.py:38: start network... 16:27:08.362603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:08.819221 run create_hlr_db(pid=24372): Launched 16:27:08.931186 bus /gobi_6: Setting Powered False 16:27:09.990717 run create_hlr_db(pid=24372): Terminated: ok {rc=0} 16:27:10.423520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24374): Launched 16:27:10.739198 run osmo-hlr_10.42.42.2(pid=24375): Launched 16:27:10.862136 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:11.403403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24377): Launched 16:27:11.718336 run osmo-stp_10.42.42.5(pid=24378): Launched 16:27:11.837735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:12.383365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24380): Launched 16:27:12.504724 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:12.778182 run patchelf(pid=24381): Launched 16:27:12.955105 run osmo-stp_10.42.42.5(pid=24378): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24378)] 16:27:13.090085 run osmo-stp_10.42.42.5(pid=24378): stdout: | (launched: 2022-12-10_16:27:11.661072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:13.226904 run osmo-stp_10.42.42.5(pid=24378): stderr: | [0;m[38;5;43m20221210162711850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162711850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162711850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162711851 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162711851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162711851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162711851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:13.363543 run osmo-stp_10.42.42.5(pid=24378): stdout: | (launched: 2022-12-10_16:27:11.661072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:13.493976 run osmo-stp_10.42.42.5(pid=24378): stderr: | [0;m[38;5;43m20221210162711850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162711850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162711850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162711851 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162711851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162711851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162711851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:13.648741 run patchelf(pid=24381): Terminating (SIGINT) 16:27:13.827611 run patchelf(pid=24381): Terminated: ok {rc=0} 16:27:13.956317 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24378): Process ended prematurely: osmo-stp_10.42.42.5(pid=24378) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24378)] [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:27:13.966292 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 16:27:13.994789 run osmo-hlr_10.42.42.2(pid=24375): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24375)] 16:27:14.044786 run osmo-hlr_10.42.42.2(pid=24375): stdout: | (launched: 2022-12-10_16:27:10.681059) 16:27:14.097128 run osmo-hlr_10.42.42.2(pid=24375): stderr: | [0;m[1;31m20221210162710878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162710878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162710878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162710878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162710878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162710878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162710890 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162710898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162710898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162710898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:14.149534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24368): Terminating (SIGTERM) 16:27:14.191531 run iperf3-srv_10.42.42.10(pid=24369): Terminating (SIGTERM) 16:27:14.233681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24370): Terminating (SIGTERM) 16:27:14.275839 run iperf3-srv_10.42.42.10(pid=24371): Terminating (SIGTERM) 16:27:14.317935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24374): Terminating (SIGTERM) 16:27:14.360041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24377): Terminating (SIGTERM) 16:27:14.401967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24380): Terminating (SIGTERM) 16:27:14.444354 --- ParallelTerminationStrategy: PID 24368 died... 16:27:14.464325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24368): Terminated: ok {rc=0} 16:27:14.511275 --- ParallelTerminationStrategy: PID 24369 died... 16:27:14.531082 run iperf3-srv_10.42.42.10(pid=24369): Terminated {rc=256} 16:27:14.577326 --- ParallelTerminationStrategy: PID 24370 died... 16:27:14.596673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24370): Terminated: ok {rc=0} 16:27:14.643294 --- ParallelTerminationStrategy: PID 24371 died... 16:27:14.662987 run iperf3-srv_10.42.42.10(pid=24371): Terminated {rc=256} 16:27:14.709311 --- ParallelTerminationStrategy: PID 24374 died... 16:27:14.729106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24374): Terminated: ok {rc=0} 16:27:14.775995 --- ParallelTerminationStrategy: PID 24377 died... 16:27:14.795840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24377): Terminated: ok {rc=0} 16:27:14.842099 --- ParallelTerminationStrategy: PID 24380 died... 16:27:14.861866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24380): Terminated: ok {rc=0} 16:27:14.949861 bus /gobi_0: Setting Powered False 16:27:16.064811 bus /gobi_0: Setting Powered False 16:27:17.196516 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:27:18.346219 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:18.358365 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:27:18.429358 tst iperf3.py: using LAC 29197 16:27:18.553255 tst iperf3.py: using RAC 127 16:27:18.677739 tst iperf3.py: using CellId 29197 16:27:18.804097 tst iperf3.py: using BVCI 29198 16:27:18.920454 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:18.932015 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:18.943352 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:18.954619 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:18.965774 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:18.976746 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:18.988001 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:18.999011 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:19.010234 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:19.127044 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:27:19.340278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:19.657627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24382): Launched 16:27:19.932566 run iperf3-srv_10.42.42.10(pid=24383): Launched 16:27:20.050846 tst iperf3.py:8: start network... 16:27:20.264728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:20.754143 run create_hlr_db(pid=24384): Launched 16:27:20.882044 bus /gobi_6: Setting Powered False 16:27:21.945271 run create_hlr_db(pid=24384): Terminated: ok {rc=0} 16:27:22.386108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24386): Launched 16:27:22.701577 run osmo-hlr_10.42.42.2(pid=24387): Launched 16:27:22.822259 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:23.374043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24389): Launched 16:27:23.689521 run osmo-stp_10.42.42.5(pid=24390): Launched 16:27:23.810011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:24.357824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24392): Launched 16:27:24.479255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:24.746902 run patchelf(pid=24393): Launched 16:27:24.922932 run osmo-stp_10.42.42.5(pid=24390): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24390)] 16:27:25.057979 run osmo-stp_10.42.42.5(pid=24390): stdout: | (launched: 2022-12-10_16:27:23.631804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:25.194901 run osmo-stp_10.42.42.5(pid=24390): stderr: | [0;m[38;5;43m20221210162723823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162723823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162723823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162723824 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162723824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162723824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162723824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:25.331202 run osmo-stp_10.42.42.5(pid=24390): stdout: | (launched: 2022-12-10_16:27:23.631804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:25.461083 run osmo-stp_10.42.42.5(pid=24390): stderr: | [0;m[38;5;43m20221210162723823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162723823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162723823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162723824 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162723824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162723824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162723824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:25.615165 run patchelf(pid=24393): Terminating (SIGINT) 16:27:25.793615 run patchelf(pid=24393): Terminated: ok {rc=0} 16:27:25.921991 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24390): Process ended prematurely: osmo-stp_10.42.42.5(pid=24390) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24390)] [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 16:27:25.931926 tst iperf3.py:8: Test FAILED (7.6 sec) 16:27:25.960616 run osmo-hlr_10.42.42.2(pid=24387): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24387)] 16:27:26.010596 run osmo-hlr_10.42.42.2(pid=24387): stdout: | (launched: 2022-12-10_16:27:22.644139) 16:27:26.062242 run osmo-hlr_10.42.42.2(pid=24387): stderr: | [0;m[1;31m20221210162722843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162722843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162722843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162722843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162722843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162722843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162722856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162722864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162722864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162722865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:26.114934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24382): Terminating (SIGTERM) 16:27:26.158417 run iperf3-srv_10.42.42.10(pid=24383): Terminating (SIGTERM) 16:27:26.200485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24386): Terminating (SIGTERM) 16:27:26.242625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24389): Terminating (SIGTERM) 16:27:26.284481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24392): Terminating (SIGTERM) 16:27:26.326987 --- ParallelTerminationStrategy: PID 24382 died... 16:27:26.347358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24382): Terminated: ok {rc=0} 16:27:26.394634 --- ParallelTerminationStrategy: PID 24383 died... 16:27:26.414333 run iperf3-srv_10.42.42.10(pid=24383): Terminated {rc=256} 16:27:26.460639 --- ParallelTerminationStrategy: PID 24386 died... 16:27:26.480416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24386): Terminated: ok {rc=0} 16:27:26.526736 --- ParallelTerminationStrategy: PID 24389 died... 16:27:26.546397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24389): Terminated: ok {rc=0} 16:27:26.592689 --- ParallelTerminationStrategy: PID 24392 died... 16:27:26.612581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24392): Terminated: ok {rc=0} 16:27:26.700638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:27:27.853563 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:27.865674 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:27:27.936839 tst iperf3m4.py: using LAC 29198 16:27:28.057935 tst iperf3m4.py: using RAC 128 16:27:28.173384 tst iperf3m4.py: using CellId 29198 16:27:28.287428 tst iperf3m4.py: using BVCI 29199 16:27:28.395274 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:28.406369 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:28.417221 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:28.428405 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:28.439297 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:28.450403 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:28.461327 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:28.471971 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:28.483055 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:28.600181 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:28.720391 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:28.836008 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:28.950391 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:27:29.150555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:29.448371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24394): Launched 16:27:29.707116 run iperf3-srv_10.42.42.10(pid=24395): Launched 16:27:29.818721 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:27:30.017827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:30.315482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24396): Launched 16:27:30.572650 run iperf3-srv_10.42.42.10(pid=24397): Launched 16:27:30.683608 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:27:30.892117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:31.224106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24398): Launched 16:27:31.549992 run iperf3-srv_10.42.42.10(pid=24399): Launched 16:27:31.682696 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:27:31.903459 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:32.228927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24400): Launched 16:27:32.505131 run iperf3-srv_10.42.42.10(pid=24401): Launched 16:27:32.624240 tst iperf3m4.py:8: start network... 16:27:32.838195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:33.330782 run create_hlr_db(pid=24402): Launched 16:27:33.459589 bus /gobi_6: Setting Powered False 16:27:34.522337 run create_hlr_db(pid=24402): Terminated: ok {rc=0} 16:27:34.945585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Launched 16:27:35.243645 run osmo-hlr_10.42.42.2(pid=24405): Launched 16:27:35.356486 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:35.878001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Launched 16:27:36.191160 run osmo-stp_10.42.42.5(pid=24410): Launched 16:27:36.311954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:36.857224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24412): Launched 16:27:36.977407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:37.244749 run patchelf(pid=24413): Launched 16:27:37.420071 run osmo-stp_10.42.42.5(pid=24410): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24410)] 16:27:37.554164 run osmo-stp_10.42.42.5(pid=24410): stdout: | (launched: 2022-12-10_16:27:36.133459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:37.689776 run osmo-stp_10.42.42.5(pid=24410): stderr: | [0;m[38;5;43m20221210162736318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162736318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162736319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162736319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162736319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162736320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162736320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:37.825681 run osmo-stp_10.42.42.5(pid=24410): stdout: | (launched: 2022-12-10_16:27:36.133459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:37.954972 run osmo-stp_10.42.42.5(pid=24410): stderr: | [0;m[38;5;43m20221210162736318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162736318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162736319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162736319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162736319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162736320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162736320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:38.108896 run patchelf(pid=24413): Terminating (SIGINT) 16:27:38.287103 run patchelf(pid=24413): Terminated: ok {rc=0} 16:27:38.415316 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24410): Process ended prematurely: osmo-stp_10.42.42.5(pid=24410) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24410)] [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:27:38.425289 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:27:38.453863 run osmo-hlr_10.42.42.2(pid=24405): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24405)] 16:27:38.504018 run osmo-hlr_10.42.42.2(pid=24405): stdout: | (launched: 2022-12-10_16:27:35.189285) 16:27:38.555619 run osmo-hlr_10.42.42.2(pid=24405): stderr: | [0;m[1;31m20221210162735362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162735362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162735362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162735362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162735362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162735362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162735374 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162735383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162735383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162735383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:38.608049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24394): Terminating (SIGTERM) 16:27:38.650019 run iperf3-srv_10.42.42.10(pid=24395): Terminating (SIGTERM) 16:27:38.691887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24396): Terminating (SIGTERM) 16:27:38.734005 run iperf3-srv_10.42.42.10(pid=24397): Terminating (SIGTERM) 16:27:38.775872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24398): Terminating (SIGTERM) 16:27:38.817858 run iperf3-srv_10.42.42.10(pid=24399): Terminating (SIGTERM) 16:27:38.859614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24400): Terminating (SIGTERM) 16:27:38.901546 run iperf3-srv_10.42.42.10(pid=24401): Terminating (SIGTERM) 16:27:38.943241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Terminating (SIGTERM) 16:27:38.985017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Terminating (SIGTERM) 16:27:39.026831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24412): Terminating (SIGTERM) 16:27:39.068996 --- ParallelTerminationStrategy: PID 24394 died... 16:27:39.089442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24394): Terminated: ok {rc=0} 16:27:39.136779 --- ParallelTerminationStrategy: PID 24395 died... 16:27:39.157101 run iperf3-srv_10.42.42.10(pid=24395): Terminated {rc=256} 16:27:39.203385 --- ParallelTerminationStrategy: PID 24396 died... 16:27:39.223060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24396): Terminated: ok {rc=0} 16:27:39.269296 --- ParallelTerminationStrategy: PID 24397 died... 16:27:39.288808 run iperf3-srv_10.42.42.10(pid=24397): Terminated {rc=256} 16:27:39.335036 --- ParallelTerminationStrategy: PID 24398 died... 16:27:39.354828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24398): Terminated: ok {rc=0} 16:27:39.401082 --- ParallelTerminationStrategy: PID 24399 died... 16:27:39.420485 run iperf3-srv_10.42.42.10(pid=24399): Terminated {rc=256} 16:27:39.466500 --- ParallelTerminationStrategy: PID 24400 died... 16:27:39.486066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24400): Terminated: ok {rc=0} 16:27:39.532137 --- ParallelTerminationStrategy: PID 24401 died... 16:27:39.551637 run iperf3-srv_10.42.42.10(pid=24401): Terminated {rc=256} 16:27:39.597969 --- ParallelTerminationStrategy: PID 24404 died... 16:27:39.617788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Terminated: ok {rc=0} 16:27:39.663997 --- ParallelTerminationStrategy: PID 24407 died... 16:27:39.683607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Terminated: ok {rc=0} 16:27:39.730014 --- ParallelTerminationStrategy: PID 24412 died... 16:27:39.749823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24412): Terminated: ok {rc=0} 16:27:39.837199 bus /gobi_4: Setting Powered False 16:27:40.936215 bus /gobi_4: Setting Powered False 16:27:42.054207 bus /gobi_1: Setting Powered False 16:27:43.155016 bus /gobi_1: Setting Powered False 16:27:44.271881 bus /gobi_0: Setting Powered False 16:27:45.369449 bus /gobi_0: Setting Powered False 16:27:46.497357 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:27:47.612523 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:47.623915 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:27:47.692902 tst ping.py: using LAC 29199 16:27:47.808674 tst ping.py: using RAC 129 16:27:47.921917 tst ping.py: using CellId 29199 16:27:48.035863 tst ping.py: using BVCI 29200 16:27:48.141517 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:48.152289 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:48.162887 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:48.173707 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:48.184504 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:48.195392 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:48.206370 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:48.216880 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:48.332169 tst ping.py:19: start network... 16:27:48.527609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:48.977553 run create_hlr_db(pid=24414): Launched 16:27:49.088165 bus /gobi_6: Setting Powered False 16:27:50.147480 run create_hlr_db(pid=24414): Terminated: ok {rc=0} 16:27:50.555163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24416): Launched 16:27:50.846749 run osmo-hlr_10.42.42.2(pid=24417): Launched 16:27:50.957461 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:51.478284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24419): Launched 16:27:51.769033 run osmo-stp_10.42.42.5(pid=24420): Launched 16:27:51.880114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:52.401878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24422): Launched 16:27:52.512685 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:52.758105 run patchelf(pid=24423): Launched 16:27:52.919543 run osmo-stp_10.42.42.5(pid=24420): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24420)] 16:27:53.042753 run osmo-stp_10.42.42.5(pid=24420): stdout: | (launched: 2022-12-10_16:27:51.714905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:53.167769 run osmo-stp_10.42.42.5(pid=24420): stderr: | [0;m[38;5;43m20221210162751893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162751894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162751894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162751894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162751895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162751895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162751895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:53.292889 run osmo-stp_10.42.42.5(pid=24420): stdout: | (launched: 2022-12-10_16:27:51.714905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:53.411880 run osmo-stp_10.42.42.5(pid=24420): stderr: | [0;m[38;5;43m20221210162751893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162751894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162751894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162751894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162751895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162751895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162751895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:53.553113 run patchelf(pid=24423): Terminating (SIGINT) 16:27:53.716051 run patchelf(pid=24423): Terminated: ok {rc=0} 16:27:53.833692 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24420): Process ended prematurely: osmo-stp_10.42.42.5(pid=24420) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24420)] [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 16:27:53.842398 tst ping.py:22: Test FAILED (6.2 sec) 16:27:53.869781 run osmo-hlr_10.42.42.2(pid=24417): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24417)] 16:27:53.917750 run osmo-hlr_10.42.42.2(pid=24417): stdout: | (launched: 2022-12-10_16:27:50.792437) 16:27:53.967471 run osmo-hlr_10.42.42.2(pid=24417): stderr: | [0;m[1;31m20221210162750967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162750967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162750967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162750967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162750967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162750968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162750979 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162750988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162750988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162750988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:54.017862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24416): Terminating (SIGTERM) 16:27:54.058090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24419): Terminating (SIGTERM) 16:27:54.098431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24422): Terminating (SIGTERM) 16:27:54.139065 --- ParallelTerminationStrategy: PID 24416 died... 16:27:54.158290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24416): Terminated: ok {rc=0} 16:27:54.203264 --- ParallelTerminationStrategy: PID 24419 died... 16:27:54.222119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24419): Terminated: ok {rc=0} 16:27:54.266977 --- ParallelTerminationStrategy: PID 24422 died... 16:27:54.285928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24422): Terminated: ok {rc=0} 16:27:54.373244 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:27:55.462169 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:55.474191 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:27:55.544660 tst ping_idle_ping.py: using LAC 29200 16:27:55.661338 tst ping_idle_ping.py: using RAC 130 16:27:55.777378 tst ping_idle_ping.py: using CellId 29200 16:27:55.892402 tst ping_idle_ping.py: using BVCI 29201 16:27:56.000130 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:56.011212 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:56.022047 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:56.032835 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:56.043856 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:56.054936 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:56.066092 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:56.076842 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:56.194629 tst ping_idle_ping.py:24: start network... 16:27:56.405886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:56.893251 run create_hlr_db(pid=24424): Launched 16:27:57.019968 bus /gobi_6: Setting Powered False 16:27:58.083077 run create_hlr_db(pid=24424): Terminated: ok {rc=0} 16:27:58.502555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24426): Launched 16:27:58.793766 run osmo-hlr_10.42.42.2(pid=24427): Launched 16:27:58.904314 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:59.405673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24429): Launched 16:27:59.698477 run osmo-stp_10.42.42.5(pid=24430): Launched 16:27:59.809251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:00.313988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24432): Launched 16:28:00.425714 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:00.671869 run patchelf(pid=24433): Launched 16:28:00.839138 run osmo-stp_10.42.42.5(pid=24430): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24430)] 16:28:00.974270 run osmo-stp_10.42.42.5(pid=24430): stdout: | (launched: 2022-12-10_16:27:59.644408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:01.103205 run osmo-stp_10.42.42.5(pid=24430): stderr: | [0;m[38;5;43m20221210162759815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162759815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162759815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162759816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162759816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162759816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162759816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:01.232757 run osmo-stp_10.42.42.5(pid=24430): stdout: | (launched: 2022-12-10_16:27:59.644408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:01.356307 run osmo-stp_10.42.42.5(pid=24430): stderr: | [0;m[38;5;43m20221210162759815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162759815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162759815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162759816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162759816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162759816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162759816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:01.502661 run patchelf(pid=24433): Terminating (SIGINT) 16:28:01.671594 run patchelf(pid=24433): Terminated: ok {rc=0} 16:28:01.794246 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24430): Process ended prematurely: osmo-stp_10.42.42.5(pid=24430) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24430)] [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:28:01.804077 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 16:28:01.834655 run osmo-hlr_10.42.42.2(pid=24427): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24427)] 16:28:01.884824 run osmo-hlr_10.42.42.2(pid=24427): stdout: | (launched: 2022-12-10_16:27:58.739921) 16:28:01.936815 run osmo-hlr_10.42.42.2(pid=24427): stderr: | [0;m[1;31m20221210162758913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162758914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162758914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162758914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162758914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162758914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162758929 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162758938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162758938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162758938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:01.992383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24426): Terminating (SIGTERM) 16:28:02.034879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24429): Terminating (SIGTERM) 16:28:02.078117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24432): Terminating (SIGTERM) 16:28:02.122319 --- ParallelTerminationStrategy: PID 24426 died... 16:28:02.142316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24426): Terminated: ok {rc=0} 16:28:02.190063 --- ParallelTerminationStrategy: PID 24429 died... 16:28:02.209059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24429): Terminated: ok {rc=0} 16:28:02.254565 --- ParallelTerminationStrategy: PID 24432 died... 16:28:02.273327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24432): Terminated: ok {rc=0} 16:28:02.357275 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:28:03.665353 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:28:03.671870 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:28:03.705880 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:28:03.745297 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:28:03.833643 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:28:03.867189 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:28:03.906306 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:28:04.501422 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:28:04.552535 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:04.563872 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:28:04.635991 tst cs_paging_gprs_active.py: using LAC 29201 16:28:04.762169 tst cs_paging_gprs_active.py: using RAC 131 16:28:04.887987 tst cs_paging_gprs_active.py: using CellId 29201 16:28:05.012674 tst cs_paging_gprs_active.py: using BVCI 29202 16:28:05.128437 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:05.139780 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:05.150848 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:05.162062 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:05.173229 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:05.184293 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:05.195483 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:05.206693 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:05.218073 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:05.333394 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:05.451830 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:28:05.652416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:05.951467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24437): Launched 16:28:06.211251 run iperf3-srv_10.42.42.10(pid=24438): Launched 16:28:06.322556 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:28:06.521980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:06.820332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24439): Launched 16:28:07.079645 run iperf3-srv_10.42.42.10(pid=24440): Launched 16:28:07.192729 tst cs_paging_gprs_active.py:38: start network... 16:28:07.393655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:07.854638 run create_hlr_db(pid=24441): Launched 16:28:07.968669 bus /gobi_6: Setting Powered False 16:28:09.028651 run create_hlr_db(pid=24441): Terminated: ok {rc=0} 16:28:09.465516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24443): Launched 16:28:09.783516 run osmo-hlr_10.42.42.2(pid=24444): Launched 16:28:09.904236 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:10.452849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24446): Launched 16:28:10.770115 run osmo-stp_10.42.42.5(pid=24447): Launched 16:28:10.890815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:11.440685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24449): Launched 16:28:11.562212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:11.830649 run patchelf(pid=24450): Launched 16:28:12.009357 run osmo-stp_10.42.42.5(pid=24447): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24447)] 16:28:12.145051 run osmo-stp_10.42.42.5(pid=24447): stdout: | (launched: 2022-12-10_16:28:10.711918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:12.282623 run osmo-stp_10.42.42.5(pid=24447): stderr: | [0;m[38;5;43m20221210162810903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162810903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162810903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162810903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162810904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162810904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162810904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:12.419901 run osmo-stp_10.42.42.5(pid=24447): stdout: | (launched: 2022-12-10_16:28:10.711918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:12.550901 run osmo-stp_10.42.42.5(pid=24447): stderr: | [0;m[38;5;43m20221210162810903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162810903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162810903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162810903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162810904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162810904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162810904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:12.705754 run patchelf(pid=24450): Terminating (SIGINT) 16:28:12.884194 run patchelf(pid=24450): Terminated: ok {rc=0} 16:28:13.013129 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24447): Process ended prematurely: osmo-stp_10.42.42.5(pid=24447) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24447)] [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:28:13.023125 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:28:13.051718 run osmo-hlr_10.42.42.2(pid=24444): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24444)] 16:28:13.101918 run osmo-hlr_10.42.42.2(pid=24444): stdout: | (launched: 2022-12-10_16:28:09.725405) 16:28:13.154143 run osmo-hlr_10.42.42.2(pid=24444): stderr: | [0;m[1;31m20221210162809922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162809922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162809922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162809922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162809922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162809922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162809935 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162809943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162809944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162809944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:13.206607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24437): Terminating (SIGTERM) 16:28:13.248836 run iperf3-srv_10.42.42.10(pid=24438): Terminating (SIGTERM) 16:28:13.290695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24439): Terminating (SIGTERM) 16:28:13.332518 run iperf3-srv_10.42.42.10(pid=24440): Terminating (SIGTERM) 16:28:13.374384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24443): Terminating (SIGTERM) 16:28:13.416162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24446): Terminating (SIGTERM) 16:28:13.457799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24449): Terminating (SIGTERM) 16:28:13.499663 --- ParallelTerminationStrategy: PID 24437 died... 16:28:13.519621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24437): Terminated: ok {rc=0} 16:28:13.565712 --- ParallelTerminationStrategy: PID 24438 died... 16:28:13.585209 run iperf3-srv_10.42.42.10(pid=24438): Terminated {rc=256} 16:28:13.631577 --- ParallelTerminationStrategy: PID 24439 died... 16:28:13.651098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24439): Terminated: ok {rc=0} 16:28:13.697100 --- ParallelTerminationStrategy: PID 24440 died... 16:28:13.716500 run iperf3-srv_10.42.42.10(pid=24440): Terminated {rc=256} 16:28:13.762258 --- ParallelTerminationStrategy: PID 24443 died... 16:28:13.781767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24443): Terminated: ok {rc=0} 16:28:13.827589 --- ParallelTerminationStrategy: PID 24446 died... 16:28:13.847084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24446): Terminated: ok {rc=0} 16:28:13.892899 --- ParallelTerminationStrategy: PID 24449 died... 16:28:13.912851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24449): Terminated: ok {rc=0} 16:28:14.001169 bus /gobi_0: Setting Powered False 16:28:15.101379 bus /gobi_0: Setting Powered False 16:28:16.223365 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:28:17.379070 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:17.390748 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:28:17.462024 tst iperf3.py: using LAC 29202 16:28:17.587310 tst iperf3.py: using RAC 132 16:28:17.714278 tst iperf3.py: using CellId 29202 16:28:17.840371 tst iperf3.py: using BVCI 29203 16:28:17.955926 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:17.967483 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:17.978897 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:17.990451 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:18.001710 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:18.013031 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:18.024426 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:18.035750 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:18.047111 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:18.165122 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:28:18.379284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:18.697642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24451): Launched 16:28:18.974079 run iperf3-srv_10.42.42.10(pid=24452): Launched 16:28:19.093182 tst iperf3.py:8: start network... 16:28:19.307802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:19.800482 run create_hlr_db(pid=24453): Launched 16:28:19.928756 bus /gobi_6: Setting Powered False 16:28:20.992395 run create_hlr_db(pid=24453): Terminated: ok {rc=0} 16:28:21.418494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24455): Launched 16:28:21.715444 run osmo-hlr_10.42.42.2(pid=24456): Launched 16:28:21.828263 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:22.341971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24458): Launched 16:28:22.638146 run osmo-stp_10.42.42.5(pid=24459): Launched 16:28:22.750610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:23.261754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24461): Launched 16:28:23.375072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:23.626282 run patchelf(pid=24462): Launched 16:28:23.790409 run osmo-stp_10.42.42.5(pid=24459): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24459)] 16:28:23.916086 run osmo-stp_10.42.42.5(pid=24459): stdout: | (launched: 2022-12-10_16:28:22.583337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:24.043122 run osmo-stp_10.42.42.5(pid=24459): stderr: | [0;m[38;5;43m20221210162822754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162822754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162822755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162822755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162822756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162822756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162822756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:24.170656 run osmo-stp_10.42.42.5(pid=24459): stdout: | (launched: 2022-12-10_16:28:22.583337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:24.291940 run osmo-stp_10.42.42.5(pid=24459): stderr: | [0;m[38;5;43m20221210162822754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162822754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162822755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162822755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162822756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162822756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162822756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:24.435624 run patchelf(pid=24462): Terminating (SIGINT) 16:28:24.602403 run patchelf(pid=24462): Terminated: ok {rc=0} 16:28:24.722751 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24459): Process ended prematurely: osmo-stp_10.42.42.5(pid=24459) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24459)] [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 16:28:24.732017 tst iperf3.py:8: Test FAILED (7.4 sec) 16:28:24.759733 run osmo-hlr_10.42.42.2(pid=24456): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24456)] 16:28:24.807486 run osmo-hlr_10.42.42.2(pid=24456): stdout: | (launched: 2022-12-10_16:28:21.660868) 16:28:24.856817 run osmo-hlr_10.42.42.2(pid=24456): stderr: | [0;m[1;31m20221210162821840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162821840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162821840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162821840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162821841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162821841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162821853 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162821861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162821861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162821861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:24.906692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24451): Terminating (SIGTERM) 16:28:24.946714 run iperf3-srv_10.42.42.10(pid=24452): Terminating (SIGTERM) 16:28:24.986644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24455): Terminating (SIGTERM) 16:28:25.026616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24458): Terminating (SIGTERM) 16:28:25.066441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24461): Terminating (SIGTERM) 16:28:25.106867 --- ParallelTerminationStrategy: PID 24451 died... 16:28:25.126026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24451): Terminated: ok {rc=0} 16:28:25.171076 --- ParallelTerminationStrategy: PID 24452 died... 16:28:25.189707 run iperf3-srv_10.42.42.10(pid=24452): Terminated {rc=256} 16:28:25.234175 --- ParallelTerminationStrategy: PID 24455 died... 16:28:25.253075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24455): Terminated: ok {rc=0} 16:28:25.297447 --- ParallelTerminationStrategy: PID 24458 died... 16:28:25.316165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24458): Terminated: ok {rc=0} 16:28:25.360513 --- ParallelTerminationStrategy: PID 24461 died... 16:28:25.379361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24461): Terminated: ok {rc=0} 16:28:25.466894 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:28:26.618237 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:26.630455 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:28:26.704400 tst iperf3m4.py: using LAC 29203 16:28:26.830878 tst iperf3m4.py: using RAC 133 16:28:26.955156 tst iperf3m4.py: using CellId 29203 16:28:27.079951 tst iperf3m4.py: using BVCI 29204 16:28:27.197147 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:27.208550 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:27.219786 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:27.231102 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:27.242393 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:27.253767 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:27.265314 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:27.276399 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:27.288543 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:27.407882 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:27.526883 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:27.645176 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:27.765180 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:28:27.980714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:28.301676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24463): Launched 16:28:28.579818 run iperf3-srv_10.42.42.10(pid=24464): Launched 16:28:28.698943 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:28:28.913747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:29.233989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24465): Launched 16:28:29.511545 run iperf3-srv_10.42.42.10(pid=24466): Launched 16:28:29.630960 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:28:29.845549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:30.165743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24467): Launched 16:28:30.442890 run iperf3-srv_10.42.42.10(pid=24468): Launched 16:28:30.561362 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:28:30.774322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:31.100244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24469): Launched 16:28:31.403805 run iperf3-srv_10.42.42.10(pid=24470): Launched 16:28:31.529316 tst iperf3m4.py:8: start network... 16:28:31.746068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:32.245715 run create_hlr_db(pid=24471): Launched 16:28:32.374335 bus /gobi_6: Setting Powered False 16:28:33.437733 run create_hlr_db(pid=24471): Terminated: ok {rc=0} 16:28:33.864570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24473): Launched 16:28:34.162892 run osmo-hlr_10.42.42.2(pid=24474): Launched 16:28:34.275870 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:34.804574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24476): Launched 16:28:35.102218 run osmo-stp_10.42.42.5(pid=24477): Launched 16:28:35.215829 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:35.727588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24479): Launched 16:28:35.841574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:36.092226 run patchelf(pid=24480): Launched 16:28:36.257677 run osmo-stp_10.42.42.5(pid=24477): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24477)] 16:28:36.383673 run osmo-stp_10.42.42.5(pid=24477): stdout: | (launched: 2022-12-10_16:28:35.047036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:36.511276 run osmo-stp_10.42.42.5(pid=24477): stderr: | [0;m[38;5;43m20221210162835215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162835215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162835215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162835216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162835216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162835216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162835216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:36.639086 run osmo-stp_10.42.42.5(pid=24477): stdout: | (launched: 2022-12-10_16:28:35.047036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:36.760693 run osmo-stp_10.42.42.5(pid=24477): stderr: | [0;m[38;5;43m20221210162835215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162835215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162835215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162835216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162835216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162835216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162835216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:36.904831 run patchelf(pid=24480): Terminating (SIGINT) 16:28:37.071825 run patchelf(pid=24480): Terminated: ok {rc=0} 16:28:37.192366 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24477): Process ended prematurely: osmo-stp_10.42.42.5(pid=24477) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24477)] [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:28:37.201860 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:28:37.230092 run osmo-hlr_10.42.42.2(pid=24474): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24474)] 16:28:37.278192 run osmo-hlr_10.42.42.2(pid=24474): stdout: | (launched: 2022-12-10_16:28:34.107677) 16:28:37.328100 run osmo-hlr_10.42.42.2(pid=24474): stderr: | [0;m[1;31m20221210162834282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162834282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162834282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162834282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162834282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162834282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162834295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162834303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162834304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162834304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:37.378260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24463): Terminating (SIGTERM) 16:28:37.418266 run iperf3-srv_10.42.42.10(pid=24464): Terminating (SIGTERM) 16:28:37.458558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24465): Terminating (SIGTERM) 16:28:37.498755 run iperf3-srv_10.42.42.10(pid=24466): Terminating (SIGTERM) 16:28:37.538722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24467): Terminating (SIGTERM) 16:28:37.579208 run iperf3-srv_10.42.42.10(pid=24468): Terminating (SIGTERM) 16:28:37.619065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24469): Terminating (SIGTERM) 16:28:37.659053 run iperf3-srv_10.42.42.10(pid=24470): Terminating (SIGTERM) 16:28:37.699090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24473): Terminating (SIGTERM) 16:28:37.739147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24476): Terminating (SIGTERM) 16:28:37.779052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24479): Terminating (SIGTERM) 16:28:37.819569 --- ParallelTerminationStrategy: PID 24463 died... 16:28:37.838861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24463): Terminated: ok {rc=0} 16:28:37.883424 --- ParallelTerminationStrategy: PID 24464 died... 16:28:37.902017 run iperf3-srv_10.42.42.10(pid=24464): Terminated {rc=256} 16:28:37.946654 --- ParallelTerminationStrategy: PID 24465 died... 16:28:37.965443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24465): Terminated: ok {rc=0} 16:28:38.010161 --- ParallelTerminationStrategy: PID 24466 died... 16:28:38.028541 run iperf3-srv_10.42.42.10(pid=24466): Terminated {rc=256} 16:28:38.072857 --- ParallelTerminationStrategy: PID 24467 died... 16:28:38.091953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24467): Terminated: ok {rc=0} 16:28:38.136327 --- ParallelTerminationStrategy: PID 24468 died... 16:28:38.154963 run iperf3-srv_10.42.42.10(pid=24468): Terminated {rc=256} 16:28:38.199481 --- ParallelTerminationStrategy: PID 24469 died... 16:28:38.218199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24469): Terminated: ok {rc=0} 16:28:38.262663 --- ParallelTerminationStrategy: PID 24470 died... 16:28:38.281280 run iperf3-srv_10.42.42.10(pid=24470): Terminated {rc=256} 16:28:38.325520 --- ParallelTerminationStrategy: PID 24473 died... 16:28:38.344310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24473): Terminated: ok {rc=0} 16:28:38.388699 --- ParallelTerminationStrategy: PID 24476 died... 16:28:38.407425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24476): Terminated: ok {rc=0} 16:28:38.451901 --- ParallelTerminationStrategy: PID 24479 died... 16:28:38.470692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24479): Terminated: ok {rc=0} 16:28:38.557265 bus /gobi_4: Setting Powered False 16:28:39.657264 bus /gobi_4: Setting Powered False 16:28:40.773153 bus /gobi_1: Setting Powered False 16:28:41.872023 bus /gobi_1: Setting Powered False 16:28:42.987560 bus /gobi_0: Setting Powered False 16:28:44.085577 bus /gobi_0: Setting Powered False 16:28:45.202479 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:28:46.305630 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:46.318089 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:28:46.394431 tst ping.py: using LAC 29204 16:28:46.551744 tst ping.py: using RAC 134 16:28:46.706482 tst ping.py: using CellId 29204 16:28:46.826981 tst ping.py: using BVCI 29205 16:28:46.938770 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:46.950827 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:46.962715 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:46.975248 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:46.989379 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:47.001960 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:47.014000 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:47.027087 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:47.145723 tst ping.py:19: start network... 16:28:47.346371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:47.799056 run create_hlr_db(pid=24481): Launched 16:28:47.910942 bus /gobi_6: Setting Powered False 16:28:48.969764 run create_hlr_db(pid=24481): Terminated: ok {rc=0} 16:28:49.400135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24483): Launched 16:28:49.714399 run osmo-hlr_10.42.42.2(pid=24484): Launched 16:28:49.832556 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:50.372325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24486): Launched 16:28:50.684493 run osmo-stp_10.42.42.5(pid=24487): Launched 16:28:50.803603 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:51.343776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24489): Launched 16:28:51.463003 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:51.727042 run patchelf(pid=24490): Launched 16:28:51.900492 run osmo-stp_10.42.42.5(pid=24487): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24487)] 16:28:52.032192 run osmo-stp_10.42.42.5(pid=24487): stdout: | (launched: 2022-12-10_16:28:50.626934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:52.166390 run osmo-stp_10.42.42.5(pid=24487): stderr: | [0;m[38;5;43m20221210162850821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162850821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162850821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162850821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162850822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162850822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162850822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:52.300153 run osmo-stp_10.42.42.5(pid=24487): stdout: | (launched: 2022-12-10_16:28:50.626934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:52.427917 run osmo-stp_10.42.42.5(pid=24487): stderr: | [0;m[38;5;43m20221210162850821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162850821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162850821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162850821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162850822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162850822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162850822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:52.579439 run patchelf(pid=24490): Terminating (SIGINT) 16:28:52.754311 run patchelf(pid=24490): Terminated: ok {rc=0} 16:28:52.880410 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24487): Process ended prematurely: osmo-stp_10.42.42.5(pid=24487) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24487)] [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 16:28:52.889823 tst ping.py:22: Test FAILED (6.6 sec) 16:28:52.918011 run osmo-hlr_10.42.42.2(pid=24484): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24484)] 16:28:52.968057 run osmo-hlr_10.42.42.2(pid=24484): stdout: | (launched: 2022-12-10_16:28:49.656797) 16:28:53.019807 run osmo-hlr_10.42.42.2(pid=24484): stderr: | [0;m[1;31m20221210162849854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162849854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162849854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162849854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162849854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162849854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162849867 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162849875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162849876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162849876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:53.072058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24483): Terminating (SIGTERM) 16:28:53.114142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24486): Terminating (SIGTERM) 16:28:53.156445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24489): Terminating (SIGTERM) 16:28:53.199713 --- ParallelTerminationStrategy: PID 24483 died... 16:28:53.219980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24483): Terminated: ok {rc=0} 16:28:53.266912 --- ParallelTerminationStrategy: PID 24486 died... 16:28:53.286832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24486): Terminated: ok {rc=0} 16:28:53.333334 --- ParallelTerminationStrategy: PID 24489 died... 16:28:53.353293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24489): Terminated: ok {rc=0} 16:28:53.441363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:28:54.528650 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:54.540784 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:28:54.614249 tst ping_idle_ping.py: using LAC 29205 16:28:54.738112 tst ping_idle_ping.py: using RAC 135 16:28:54.864777 tst ping_idle_ping.py: using CellId 29205 16:28:54.986851 tst ping_idle_ping.py: using BVCI 29206 16:28:55.094457 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:55.105538 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:55.116430 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:55.128074 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:55.139621 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:55.151159 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:55.162874 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:55.174602 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:55.289974 tst ping_idle_ping.py:24: start network... 16:28:55.501811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:55.991278 run create_hlr_db(pid=24491): Launched 16:28:56.119686 bus /gobi_6: Setting Powered False 16:28:57.183097 run create_hlr_db(pid=24491): Terminated: ok {rc=0} 16:28:57.606716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24493): Launched 16:28:57.899923 run osmo-hlr_10.42.42.2(pid=24494): Launched 16:28:58.011495 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:58.517068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24496): Launched 16:28:58.810087 run osmo-stp_10.42.42.5(pid=24497): Launched 16:28:58.921608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:59.425782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24499): Launched 16:28:59.537945 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:59.785524 run patchelf(pid=24500): Launched 16:28:59.948096 run osmo-stp_10.42.42.5(pid=24497): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24497)] 16:29:00.072176 run osmo-stp_10.42.42.5(pid=24497): stdout: | (launched: 2022-12-10_16:28:58.755345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:00.198517 run osmo-stp_10.42.42.5(pid=24497): stderr: | [0;m[38;5;43m20221210162858925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162858925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162858925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162858926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162858926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162858926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162858926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:00.324234 run osmo-stp_10.42.42.5(pid=24497): stdout: | (launched: 2022-12-10_16:28:58.755345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:00.444595 run osmo-stp_10.42.42.5(pid=24497): stderr: | [0;m[38;5;43m20221210162858925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162858925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162858925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162858926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162858926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162858926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162858926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:00.586663 run patchelf(pid=24500): Terminating (SIGINT) 16:29:00.750936 run patchelf(pid=24500): Terminated: ok {rc=0} 16:29:00.872291 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24497): Process ended prematurely: osmo-stp_10.42.42.5(pid=24497) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24497)] [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:29:00.886374 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 16:29:00.917046 run osmo-hlr_10.42.42.2(pid=24494): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24494)] 16:29:00.967059 run osmo-hlr_10.42.42.2(pid=24494): stdout: | (launched: 2022-12-10_16:28:57.846102) 16:29:01.019079 run osmo-hlr_10.42.42.2(pid=24494): stderr: | [0;m[1;31m20221210162858023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162858023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162858023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162858023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162858023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162858023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162858036 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162858046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162858046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162858046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:01.071656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24493): Terminating (SIGTERM) 16:29:01.115061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24496): Terminating (SIGTERM) 16:29:01.159396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24499): Terminating (SIGTERM) 16:29:01.203999 --- ParallelTerminationStrategy: PID 24493 died... 16:29:01.223921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24493): Terminated: ok {rc=0} 16:29:01.271944 --- ParallelTerminationStrategy: PID 24496 died... 16:29:01.291670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24496): Terminated: ok {rc=0} 16:29:01.339716 --- ParallelTerminationStrategy: PID 24499 died... 16:29:01.359804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24499): Terminated: ok {rc=0} 16:29:01.448770 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:29:02.747387 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:02.753985 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:29:02.787663 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:29:02.822314 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:29:02.875536 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:29:02.909455 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:29:02.943971 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:29:03.497511 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:29:03.502777 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:03.514035 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:29:03.582594 tst switch_tch_pdch.py: using LAC 29206 16:29:03.696722 tst switch_tch_pdch.py: using RAC 136 16:29:03.812812 tst switch_tch_pdch.py: using CellId 29206 16:29:03.931838 tst switch_tch_pdch.py: using BVCI 29207 16:29:04.039848 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:04.050988 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:04.061909 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:04.073082 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:04.084215 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:04.095359 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:04.106772 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:04.117918 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:29:04.234994 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:29:04.356306 tst switch_tch_pdch.py:51: start network... 16:29:04.553345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:05.005681 run create_hlr_db(pid=24504): Launched 16:29:05.116215 bus /gobi_6: Setting Powered False 16:29:06.175857 run create_hlr_db(pid=24504): Terminated: ok {rc=0} 16:29:06.605638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24506): Launched 16:29:06.917971 run osmo-hlr_10.42.42.2(pid=24507): Launched 16:29:07.036783 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:07.573937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24509): Launched 16:29:07.885645 run osmo-stp_10.42.42.5(pid=24510): Launched 16:29:08.004666 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:08.546487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24512): Launched 16:29:08.665161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:08.927988 run patchelf(pid=24513): Launched 16:29:09.101056 run osmo-stp_10.42.42.5(pid=24510): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24510)] 16:29:09.233961 run osmo-stp_10.42.42.5(pid=24510): stdout: | (launched: 2022-12-10_16:29:07.828321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:09.368035 run osmo-stp_10.42.42.5(pid=24510): stderr: | [0;m[38;5;43m20221210162908018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162908018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162908018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162908018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162908021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162908021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162908021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:09.501908 run osmo-stp_10.42.42.5(pid=24510): stdout: | (launched: 2022-12-10_16:29:07.828321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:09.629881 run osmo-stp_10.42.42.5(pid=24510): stderr: | [0;m[38;5;43m20221210162908018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162908018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162908018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162908018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162908021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162908021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162908021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:09.781478 run patchelf(pid=24513): Terminating (SIGINT) 16:29:09.956619 run patchelf(pid=24513): Terminated: ok {rc=0} 16:29:10.082546 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24510): Process ended prematurely: osmo-stp_10.42.42.5(pid=24510) [trial-2376↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24510)] [trial-2376↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:29:10.091976 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 16:29:10.120115 run osmo-hlr_10.42.42.2(pid=24507): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24507)] 16:29:10.170333 run osmo-hlr_10.42.42.2(pid=24507): stdout: | (launched: 2022-12-10_16:29:06.860831) 16:29:10.221856 run osmo-hlr_10.42.42.2(pid=24507): stderr: | [0;m[1;31m20221210162907057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162907057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162907057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162907057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162907058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162907058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162907070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162907078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162907078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162907078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:10.273657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24506): Terminating (SIGTERM) 16:29:10.315740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24509): Terminating (SIGTERM) 16:29:10.357750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24512): Terminating (SIGTERM) 16:29:10.399941 --- ParallelTerminationStrategy: PID 24506 died... 16:29:10.420024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24506): Terminated: ok {rc=0} 16:29:10.466794 --- ParallelTerminationStrategy: PID 24509 died... 16:29:10.486558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24509): Terminated: ok {rc=0} 16:29:10.532928 --- ParallelTerminationStrategy: PID 24512 died... 16:29:10.552759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24512): Terminated: ok {rc=0} 16:29:10.639405 bus /gobi_0: Setting Powered False 16:29:11.738809 bus /gobi_0: Setting Powered False 16:29:12.854416 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:29:14.106497 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:14.112169 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:29:14.145944 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:29:14.180072 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:29:14.235089 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:29:14.269400 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:29:14.304877 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:29:14.853451 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:29:14.858638 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:14.869798 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:29:14.938627 tst switch_tch_pdch.py: using LAC 29207 16:29:15.053339 tst switch_tch_pdch.py: using RAC 137 16:29:15.168510 tst switch_tch_pdch.py: using CellId 29207 16:29:15.283399 tst switch_tch_pdch.py: using BVCI 29208 16:29:15.389197 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:15.400103 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:15.410744 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:15.421702 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:15.432442 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:15.443469 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:15.454636 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:15.465550 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:29:15.579664 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:29:15.694457 tst switch_tch_pdch.py:51: start network... 16:29:15.899307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:16.338082 run create_hlr_db(pid=24518): Launched 16:29:16.486494 bus /gobi_6: Setting Powered False 16:29:17.544387 run create_hlr_db(pid=24518): Terminated: ok {rc=0} 16:29:17.946043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24520): Launched 16:29:18.257098 run osmo-hlr_10.42.42.2(pid=24521): Launched 16:29:18.375689 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:18.885643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24523): Launched 16:29:19.197310 run osmo-stp_10.42.42.5(pid=24524): Launched 16:29:19.316481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:19.829297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24526): Launched 16:29:19.948618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:20.213553 run patchelf(pid=24527): Launched 16:29:20.386978 run osmo-stp_10.42.42.5(pid=24524): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24524)] 16:29:20.518837 run osmo-stp_10.42.42.5(pid=24524): stdout: | (launched: 2022-12-10_16:29:19.139913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:20.652476 run osmo-stp_10.42.42.5(pid=24524): stderr: | [0;m[38;5;43m20221210162919333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162919333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162919334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162919334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162919336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162919336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162919336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:20.786139 run osmo-stp_10.42.42.5(pid=24524): stdout: | (launched: 2022-12-10_16:29:19.139913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:20.913839 run osmo-stp_10.42.42.5(pid=24524): stderr: | [0;m[38;5;43m20221210162919333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162919333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162919334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162919334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162919336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162919336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162919336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:21.065238 run patchelf(pid=24527): Terminating (SIGINT) 16:29:21.240759 run patchelf(pid=24527): Terminated: ok {rc=0} 16:29:21.367147 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24524): Process ended prematurely: osmo-stp_10.42.42.5(pid=24524) [trial-2376↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24524)] [trial-2376↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:29:21.376412 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:29:21.404162 run osmo-hlr_10.42.42.2(pid=24521): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24521)] 16:29:21.453511 run osmo-hlr_10.42.42.2(pid=24521): stdout: | (launched: 2022-12-10_16:29:18.199839) 16:29:21.504666 run osmo-hlr_10.42.42.2(pid=24521): stderr: | [0;m[1;31m20221210162918396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162918396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162918396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162918396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162918396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162918396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162918409 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162918417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162918417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162918417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:21.556408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24520): Terminating (SIGTERM) 16:29:21.597680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24523): Terminating (SIGTERM) 16:29:21.639068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24526): Terminating (SIGTERM) 16:29:21.680766 --- ParallelTerminationStrategy: PID 24520 died... 16:29:21.700706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24520): Terminated: ok {rc=0} 16:29:21.746464 --- ParallelTerminationStrategy: PID 24523 died... 16:29:21.765920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24523): Terminated: ok {rc=0} 16:29:21.811923 --- ParallelTerminationStrategy: PID 24526 died... 16:29:21.831460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24526): Terminated: ok {rc=0} 16:29:21.919495 bus /gobi_0: Setting Powered False 16:29:23.018127 bus /gobi_0: Setting Powered False 16:29:24.134287 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 16:29:25.383664 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:25.388569 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:29:25.418465 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 16:29:25.425493 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:29:25.478719 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:29:25.508483 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 16:29:25.515410 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:29:26.053812 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 16:29:26.058902 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 16:29:26.070278 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:29:26.114189 tst mo_mt_sms.py: using LAC 29208 16:29:26.238358 tst mo_mt_sms.py: using RAC 138 16:29:26.361263 tst mo_mt_sms.py: using CellId 29208 16:29:26.483117 tst mo_mt_sms.py: using BVCI 29209 16:29:26.595401 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:29:26.709200 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:29:26.821052 tst mo_mt_sms.py:9: start nitb and bts... 16:29:27.017637 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:29:27.612857 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24532): Launched 16:29:27.904866 run osmo-nitb_10.42.42.2(pid=24533): Launched 16:29:28.066965 run osmo-nitb_10.42.42.2(pid=24533): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24533)] 16:29:28.198442 run osmo-nitb_10.42.42.2(pid=24533): stdout: | (launched: 2022-12-10_16:29:27.850730) 16:29:28.331368 run osmo-nitb_10.42.42.2(pid=24533): stderr: | (launched: 2022-12-10_16:29:27.894122) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:29:28.464266 run osmo-nitb_10.42.42.2(pid=24533): stdout: | (launched: 2022-12-10_16:29:27.850730) 16:29:28.591516 run osmo-nitb_10.42.42.2(pid=24533): stderr: | (launched: 2022-12-10_16:29:27.894122) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24533) [trial-2376↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24533)] 16:29:29.015410 tst osmo-nitb_10.42.42.2(pid=24533): stdout: | (launched: 2022-12-10_16:29:27.850730) 16:29:29.133747 tst osmo-nitb_10.42.42.2(pid=24533): stderr: | (launched: 2022-12-10_16:29:27.894122) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:29:29.272727 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24533) [trial-2376↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24533)] [trial-2376↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 16:29:29.281005 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 16:29:29.287426 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24532): Terminating (SIGTERM) 16:29:29.496101 --- ParallelTerminationStrategy: PID 24532 died... 16:29:29.516382 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24532): Terminated: ok {rc=0} 16:29:29.602258 bus /sierra_3: Setting Powered False 16:29:30.702159 bus /sierra_3: Setting Powered False 16:29:31.824345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 16:29:33.018665 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:33.022500 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:29:33.052002 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:29:33.078076 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:29:33.128258 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:29:33.159643 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:29:33.187630 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:29:33.735144 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 16:29:33.740699 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:33.751927 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:29:33.797897 tst mo_mt_sms.py: using LAC 29209 16:29:33.920513 tst mo_mt_sms.py: using RAC 139 16:29:34.042142 tst mo_mt_sms.py: using CellId 29209 16:29:34.165797 tst mo_mt_sms.py: using BVCI 29210 16:29:34.280054 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:34.291143 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:34.302265 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:34.313236 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:34.324118 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:34.335027 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:29:34.450484 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:29:34.568428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:35.053198 run create_hlr_db(pid=24537): Launched 16:29:35.180696 bus /sierra_2: Setting Powered False 16:29:36.243515 run create_hlr_db(pid=24537): Terminated: ok {rc=0} 16:29:36.663542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24539): Launched 16:29:36.956218 run osmo-hlr_10.42.42.2(pid=24540): Launched 16:29:37.067916 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:37.584599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24542): Launched 16:29:37.876173 run osmo-stp_10.42.42.5(pid=24543): Launched 16:29:37.987081 run osmo-msc_10.42.42.6: Starting osmo-msc 16:29:38.518830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24545): Launched 16:29:38.811640 run osmo-msc_10.42.42.6(pid=24546): Launched 16:29:38.974964 run osmo-stp_10.42.42.5(pid=24543): ERR: Terminated: ERROR {rc=1} [trial-2376↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24543)] 16:29:39.098858 run osmo-stp_10.42.42.5(pid=24543): stdout: | (launched: 2022-12-10_16:29:37.822193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:39.223133 run osmo-stp_10.42.42.5(pid=24543): stderr: | [0;m[38;5;43m20221210162937992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162937992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162937993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162937993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162937994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162937994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162937994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:39.346029 run osmo-stp_10.42.42.5(pid=24543): stdout: | (launched: 2022-12-10_16:29:37.822193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:39.462181 run osmo-stp_10.42.42.5(pid=24543): stderr: | [0;m[38;5;43m20221210162937992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162937992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162937993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162937993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162937994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162937994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162937994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:39.601515 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24543): Process ended prematurely: osmo-stp_10.42.42.5(pid=24543) [trial-2376↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24543)] [trial-2376↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 16:29:39.609568 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 16:29:39.636249 run osmo-hlr_10.42.42.2(pid=24540): ERR: Terminated: ERROR {rc=237} [trial-2376↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24540)] 16:29:39.684602 run osmo-hlr_10.42.42.2(pid=24540): stdout: | (launched: 2022-12-10_16:29:36.901981) 16:29:39.734462 run osmo-hlr_10.42.42.2(pid=24540): stderr: | [0;m[1;31m20221210162937078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162937078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162937078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162937078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162937078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162937078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162937091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162937101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162937101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162937101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:39.804234 run osmo-msc_10.42.42.6(pid=24546): ERR: Terminated: ERROR {rc=2} [trial-2376↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24546)] 16:29:39.852379 run osmo-msc_10.42.42.6(pid=24546): stdout: | (launched: 2022-12-10_16:29:38.757073) 16:29:39.902049 run osmo-msc_10.42.42.6(pid=24546): stderr: | [0;m[38;5;43m20221210162939030 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162939030 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f95a9c6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162939030 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162939030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162939030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162939030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162939032 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162939032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162939033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162939033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:29:39.952348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24539): Terminating (SIGTERM) 16:29:39.992329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24542): Terminating (SIGTERM) 16:29:40.032489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24545): Terminating (SIGTERM) 16:29:40.073331 --- ParallelTerminationStrategy: PID 24539 died... 16:29:40.092594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24539): Terminated: ok {rc=0} 16:29:40.137611 --- ParallelTerminationStrategy: PID 24542 died... 16:29:40.156251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24542): Terminated: ok {rc=0} 16:29:40.201112 --- ParallelTerminationStrategy: PID 24545 died... 16:29:40.219938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24545): Terminated: ok {rc=0} 16:29:40.303962 bus /sierra_3: Setting Powered False 16:29:41.399689 bus /sierra_3: Setting Powered False 16:29:42.515107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 16:29:43.746068 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:43.749984 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:29:43.779806 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 16:29:43.786797 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 16:29:43.823190 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:29:43.851999 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 16:29:43.859053 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 16:29:44.382013 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2376 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 16:29:44.388194 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 16:29:44.400056 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:29:44.442888 tst assert_extension.py: using LAC 29210 16:29:44.558216 tst assert_extension.py: using RAC 140 16:29:44.673215 tst assert_extension.py: using CellId 29210 16:29:44.787594 tst assert_extension.py: using BVCI 29211 16:29:44.892918 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 16:29:45.007487 tst assert_extension.py:10: start nitb and bts... 16:29:45.219295 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:29:45.878470 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24551): Launched 16:29:46.213751 run osmo-nitb_10.42.42.2(pid=24552): Launched 16:29:46.407013 run osmo-nitb_10.42.42.2(pid=24552): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24552)] 16:29:46.549307 run osmo-nitb_10.42.42.2(pid=24552): stdout: | (launched: 2022-12-10_16:29:46.154599) 16:29:46.694191 run osmo-nitb_10.42.42.2(pid=24552): stderr: | (launched: 2022-12-10_16:29:46.202053) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:29:46.838657 run osmo-nitb_10.42.42.2(pid=24552): stdout: | (launched: 2022-12-10_16:29:46.154599) 16:29:46.977078 run osmo-nitb_10.42.42.2(pid=24552): stderr: | (launched: 2022-12-10_16:29:46.202053) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24552): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24552) [trial-2376↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24552)] 16:29:47.350792 tst osmo-nitb_10.42.42.2(pid=24552): stdout: | (launched: 2022-12-10_16:29:46.154599) 16:29:47.477662 tst osmo-nitb_10.42.42.2(pid=24552): stderr: | (launched: 2022-12-10_16:29:46.202053) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:29:47.626444 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24552): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24552) [trial-2376↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24552)] [trial-2376↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 16:29:47.635241 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:29:47.642423 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24551): Terminating (SIGTERM) 16:29:47.852934 --- ParallelTerminationStrategy: PID 24551 died... 16:29:47.874539 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24551): Terminated: ok {rc=0} 16:29:47.962642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 16:29:49.137411 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:49.141509 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:29:49.171251 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:29:49.198079 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 16:29:49.232699 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:29:49.262063 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:29:49.289149 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 16:29:49.821478 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 16:29:49.826764 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:49.838271 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:29:49.882706 tst assert_extension.py: using LAC 29211 16:29:50.006514 tst assert_extension.py: using RAC 141 16:29:50.122318 tst assert_extension.py: using CellId 29211 16:29:50.238785 tst assert_extension.py: using BVCI 29212 16:29:50.346840 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:50.357769 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:50.368468 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:50.379434 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:50.390295 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:50.401140 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 16:29:50.517324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:51.001906 run create_hlr_db(pid=24557): Launched 16:29:51.129798 bus /sierra_2: Setting Powered False 16:29:52.193062 run create_hlr_db(pid=24557): Terminated: ok {rc=0} 16:29:52.611796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24559): Launched 16:29:52.924013 run osmo-hlr_10.42.42.2(pid=24560): Launched 16:29:53.043319 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:53.584768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24562): Launched 16:29:53.898289 run osmo-stp_10.42.42.5(pid=24563): Launched 16:29:54.016413 run osmo-msc_10.42.42.6: Starting osmo-msc 16:29:54.582480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24565): Launched 16:29:54.894834 run osmo-msc_10.42.42.6(pid=24566): Launched 16:29:55.068594 run osmo-stp_10.42.42.5(pid=24563): ERR: Terminated: ERROR {rc=1} [trial-2376↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24563)] 16:29:55.200197 run osmo-stp_10.42.42.5(pid=24563): stdout: | (launched: 2022-12-10_16:29:53.840525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:55.333535 run osmo-stp_10.42.42.5(pid=24563): stderr: | [0;m[38;5;43m20221210162954031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162954031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162954032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162954032 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162954034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162954034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162954034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:55.465160 run osmo-stp_10.42.42.5(pid=24563): stdout: | (launched: 2022-12-10_16:29:53.840525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:55.589988 run osmo-stp_10.42.42.5(pid=24563): stderr: | [0;m[38;5;43m20221210162954031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210162954031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210162954032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210162954032 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210162954034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210162954034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210162954034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:55.738735 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24563): Process ended prematurely: osmo-stp_10.42.42.5(pid=24563) [trial-2376↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24563)] [trial-2376↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 16:29:55.747242 tst assert_extension.py:17: Test FAILED (5.9 sec) 16:29:55.774902 run osmo-hlr_10.42.42.2(pid=24560): ERR: Terminated: ERROR {rc=237} [trial-2376↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24560)] 16:29:55.824673 run osmo-hlr_10.42.42.2(pid=24560): stdout: | (launched: 2022-12-10_16:29:52.866689) 16:29:55.876276 run osmo-hlr_10.42.42.2(pid=24560): stderr: | [0;m[1;31m20221210162953064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210162953064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210162953064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210162953064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210162953064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210162953064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210162953081 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210162953089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210162953089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210162953089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:55.948617 run osmo-msc_10.42.42.6(pid=24566): ERR: Terminated: ERROR {rc=2} [trial-2376↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24566)] 16:29:55.998616 run osmo-msc_10.42.42.6(pid=24566): stdout: | (launched: 2022-12-10_16:29:54.837326) 16:29:56.050471 run osmo-msc_10.42.42.6(pid=24566): stderr: | [0;m[38;5;43m20221210162955158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210162955158 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa2b4004c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210162955158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210162955158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210162955158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210162955159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210162955160 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210162955161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210162955161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210162955161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:29:56.102464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24559): Terminating (SIGTERM) 16:29:56.144255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24562): Terminating (SIGTERM) 16:29:56.187091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24565): Terminating (SIGTERM) 16:29:56.230096 --- ParallelTerminationStrategy: PID 24559 died... 16:29:56.250465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24559): Terminated: ok {rc=0} 16:29:56.297565 --- ParallelTerminationStrategy: PID 24562 died... 16:29:56.317336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24562): Terminated: ok {rc=0} 16:29:56.363914 --- ParallelTerminationStrategy: PID 24565 died... 16:29:56.383708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24565): Terminated: ok {rc=0} 16:29:56.472238 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:29:57.684731 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:57.692112 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:29:57.722092 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:29:57.749394 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:29:57.802606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:29:57.832671 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:29:57.859874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:29:58.412764 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:29:58.464663 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:29:58.476060 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:29:58.541121 tst mo_mt_call.py: using LAC 29212 16:29:58.664342 tst mo_mt_call.py: using RAC 142 16:29:58.780927 tst mo_mt_call.py: using CellId 29212 16:29:58.897234 tst mo_mt_call.py: using BVCI 29213 16:29:59.006346 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:29:59.017632 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:29:59.028720 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:29:59.040233 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:29:59.051665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:29:59.062882 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:29:59.175440 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:29:59.292644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:59.755208 run create_hlr_db(pid=24571): Launched 16:29:59.867656 bus /sierra_2: Setting Powered False 16:30:00.944650 run create_hlr_db(pid=24571): Terminated: ok {rc=0} 16:30:01.409695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24573): Launched 16:30:01.734863 run osmo-hlr_10.42.42.2(pid=24577): Launched 16:30:01.910693 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:02.588181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24579): Launched 16:30:02.906164 run osmo-stp_10.42.42.5(pid=24580): Launched 16:30:03.026727 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:03.600574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24582): Launched 16:30:03.918331 run osmo-msc_10.42.42.6(pid=24583): Launched 16:30:04.094505 run osmo-stp_10.42.42.5(pid=24580): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24580)] 16:30:04.227940 run osmo-stp_10.42.42.5(pid=24580): stdout: | (launched: 2022-12-10_16:30:02.847899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:04.362572 run osmo-stp_10.42.42.5(pid=24580): stderr: | [0;m[38;5;43m20221210163003038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163003038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163003038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163003039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163003039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163003039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163003039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:04.495932 run osmo-stp_10.42.42.5(pid=24580): stdout: | (launched: 2022-12-10_16:30:02.847899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:04.622536 run osmo-stp_10.42.42.5(pid=24580): stderr: | [0;m[38;5;43m20221210163003038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163003038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163003038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163003039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163003039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163003039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163003039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:04.774114 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24580): Process ended prematurely: osmo-stp_10.42.42.5(pid=24580) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24580)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:30:04.783492 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:30:04.811153 run osmo-hlr_10.42.42.2(pid=24577): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24577)] 16:30:04.860738 run osmo-hlr_10.42.42.2(pid=24577): stdout: | (launched: 2022-12-10_16:30:01.674168) 16:30:04.912117 run osmo-hlr_10.42.42.2(pid=24577): stderr: | [0;m[1;31m20221210163002028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163002028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163002028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163002028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163002028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163002028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163002048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163002062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163002062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163002062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:04.983692 run osmo-msc_10.42.42.6(pid=24583): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24583)] 16:30:05.033143 run osmo-msc_10.42.42.6(pid=24583): stdout: | (launched: 2022-12-10_16:30:03.860135) 16:30:05.084251 run osmo-msc_10.42.42.6(pid=24583): stderr: | [0;m[38;5;43m20221210163004181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163004181 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feb481f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163004182 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163004182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163004182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163004182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163004184 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163004184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163004184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163004184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:05.135679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24573): Terminating (SIGTERM) 16:30:05.177407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24579): Terminating (SIGTERM) 16:30:05.218760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24582): Terminating (SIGTERM) 16:30:05.260349 --- ParallelTerminationStrategy: PID 24573 died... 16:30:05.280229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24573): Terminated: ok {rc=0} 16:30:05.326133 --- ParallelTerminationStrategy: PID 24579 died... 16:30:05.345566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24579): Terminated: ok {rc=0} 16:30:05.391180 --- ParallelTerminationStrategy: PID 24582 died... 16:30:05.410583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24582): Terminated: ok {rc=0} 16:30:05.497327 bus /sierra_3: Setting Powered False 16:30:06.593312 bus /sierra_3: Setting Powered False 16:30:07.704304 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:30:08.852054 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:08.864401 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:30:08.932129 tst mo_mt_call_osmux.py: using LAC 29213 16:30:09.056687 tst mo_mt_call_osmux.py: using RAC 143 16:30:09.181335 tst mo_mt_call_osmux.py: using CellId 29213 16:30:09.307387 tst mo_mt_call_osmux.py: using BVCI 29214 16:30:09.422509 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:09.434288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:09.445808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:09.457403 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:09.468877 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:09.480416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:30:09.598142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:30:09.711881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:10.173709 run create_hlr_db(pid=24585): Launched 16:30:10.287479 bus /sierra_2: Setting Powered False 16:30:11.346962 run create_hlr_db(pid=24585): Terminated: ok {rc=0} 16:30:11.783253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24587): Launched 16:30:12.102963 run osmo-hlr_10.42.42.2(pid=24588): Launched 16:30:12.224454 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:12.770960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24590): Launched 16:30:13.088353 run osmo-stp_10.42.42.5(pid=24591): Launched 16:30:13.209434 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:13.788487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24593): Launched 16:30:14.105908 run osmo-msc_10.42.42.6(pid=24594): Launched 16:30:14.282810 run osmo-stp_10.42.42.5(pid=24591): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24591)] 16:30:14.416675 run osmo-stp_10.42.42.5(pid=24591): stdout: | (launched: 2022-12-10_16:30:13.030205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:14.550932 run osmo-stp_10.42.42.5(pid=24591): stderr: | [0;m[38;5;43m20221210163013222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163013222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163013223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163013223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163013225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163013226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163013226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:14.684766 run osmo-stp_10.42.42.5(pid=24591): stdout: | (launched: 2022-12-10_16:30:13.030205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:14.811508 run osmo-stp_10.42.42.5(pid=24591): stderr: | [0;m[38;5;43m20221210163013222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163013222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163013223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163013223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163013225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163013226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163013226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:14.963169 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24591): Process ended prematurely: osmo-stp_10.42.42.5(pid=24591) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24591)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:30:14.972406 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:30:15.000276 run osmo-hlr_10.42.42.2(pid=24588): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24588)] 16:30:15.050196 run osmo-hlr_10.42.42.2(pid=24588): stdout: | (launched: 2022-12-10_16:30:12.044437) 16:30:15.102905 run osmo-hlr_10.42.42.2(pid=24588): stderr: | [0;m[1;31m20221210163012243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163012243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163012243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163012243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163012243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163012243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163012255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163012263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163012264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163012264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:15.175124 run osmo-msc_10.42.42.6(pid=24594): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24594)] 16:30:15.224634 run osmo-msc_10.42.42.6(pid=24594): stdout: | (launched: 2022-12-10_16:30:14.047772) 16:30:15.275473 run osmo-msc_10.42.42.6(pid=24594): stderr: | [0;m[38;5;43m20221210163014372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163014372 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba91efcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163014372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163014372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163014373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163014373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163014375 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163014375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163014375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163014375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:15.326852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24587): Terminating (SIGTERM) 16:30:15.368085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24590): Terminating (SIGTERM) 16:30:15.409291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24593): Terminating (SIGTERM) 16:30:15.450665 --- ParallelTerminationStrategy: PID 24587 died... 16:30:15.470178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24587): Terminated: ok {rc=0} 16:30:15.515959 --- ParallelTerminationStrategy: PID 24590 died... 16:30:15.535243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24590): Terminated: ok {rc=0} 16:30:15.581086 --- ParallelTerminationStrategy: PID 24593 died... 16:30:15.600476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24593): Terminated: ok {rc=0} 16:30:15.687295 bus /sierra_3: Setting Powered False 16:30:16.783950 bus /sierra_3: Setting Powered False 16:30:17.903827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:30:19.152684 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:30:19.159832 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:30:19.190233 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:30:19.217732 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:30:19.270907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:30:19.300469 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:30:19.327726 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:30:19.881282 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:30:19.932387 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:19.944174 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:30:20.011446 tst mo_mt_call.py: using LAC 29214 16:30:20.140173 tst mo_mt_call.py: using RAC 144 16:30:20.266574 tst mo_mt_call.py: using CellId 29214 16:30:20.391103 tst mo_mt_call.py: using BVCI 29215 16:30:20.506667 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:20.518389 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:20.529895 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:20.541497 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:20.553097 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:20.564569 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:30:20.682526 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:30:20.800156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:21.293662 run create_hlr_db(pid=24601): Launched 16:30:21.421826 bus /sierra_2: Setting Powered False 16:30:22.484262 run create_hlr_db(pid=24601): Terminated: ok {rc=0} 16:30:22.909305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24603): Launched 16:30:23.207559 run osmo-hlr_10.42.42.2(pid=24604): Launched 16:30:23.320824 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:23.846039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24606): Launched 16:30:24.143838 run osmo-stp_10.42.42.5(pid=24607): Launched 16:30:24.257004 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:24.798026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24609): Launched 16:30:25.095877 run osmo-msc_10.42.42.6(pid=24610): Launched 16:30:25.263010 run osmo-stp_10.42.42.5(pid=24607): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24607)] 16:30:25.391440 run osmo-stp_10.42.42.5(pid=24607): stdout: | (launched: 2022-12-10_16:30:24.088901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:25.518565 run osmo-stp_10.42.42.5(pid=24607): stderr: | [0;m[38;5;43m20221210163024259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163024259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163024259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163024260 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163024260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163024260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163024261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:25.643112 run osmo-stp_10.42.42.5(pid=24607): stdout: | (launched: 2022-12-10_16:30:24.088901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:25.762156 run osmo-stp_10.42.42.5(pid=24607): stderr: | [0;m[38;5;43m20221210163024259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163024259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163024259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163024260 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163024260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163024260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163024261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:25.904542 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24607): Process ended prematurely: osmo-stp_10.42.42.5(pid=24607) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24607)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:30:25.913522 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:30:25.940366 run osmo-hlr_10.42.42.2(pid=24604): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24604)] 16:30:25.987710 run osmo-hlr_10.42.42.2(pid=24604): stdout: | (launched: 2022-12-10_16:30:23.152701) 16:30:26.036833 run osmo-hlr_10.42.42.2(pid=24604): stderr: | [0;m[1;31m20221210163023329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163023329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163023329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163023329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163023329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163023329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163023343 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163023353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163023353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163023353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:26.105435 run osmo-msc_10.42.42.6(pid=24610): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24610)] 16:30:26.153164 run osmo-msc_10.42.42.6(pid=24610): stdout: | (launched: 2022-12-10_16:30:25.040751) 16:30:26.202218 run osmo-msc_10.42.42.6(pid=24610): stderr: | [0;m[38;5;43m20221210163025313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163025313 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff35c63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163025313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163025313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163025314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163025314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163025316 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163025316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163025317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163025317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:26.251738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24603): Terminating (SIGTERM) 16:30:26.291367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24606): Terminating (SIGTERM) 16:30:26.330934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24609): Terminating (SIGTERM) 16:30:26.370815 --- ParallelTerminationStrategy: PID 24603 died... 16:30:26.389500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24603): Terminated: ok {rc=0} 16:30:26.433731 --- ParallelTerminationStrategy: PID 24606 died... 16:30:26.452246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24606): Terminated: ok {rc=0} 16:30:26.496245 --- ParallelTerminationStrategy: PID 24609 died... 16:30:26.514897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24609): Terminated: ok {rc=0} 16:30:26.598138 bus /sierra_3: Setting Powered False 16:30:27.693694 bus /sierra_3: Setting Powered False 16:30:28.807767 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:30:29.952487 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:29.964342 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:30:30.029712 tst mo_mt_call_osmux.py: using LAC 29215 16:30:30.147874 tst mo_mt_call_osmux.py: using RAC 145 16:30:30.267452 tst mo_mt_call_osmux.py: using CellId 29215 16:30:30.389806 tst mo_mt_call_osmux.py: using BVCI 29216 16:30:30.498722 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:30.510060 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:30.521094 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:30.532349 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:30.543733 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:30.555416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:30:30.669307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:30:30.788166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:31.302354 run create_hlr_db(pid=24612): Launched 16:30:31.466883 bus /sierra_2: Setting Powered False 16:30:32.530394 run create_hlr_db(pid=24612): Terminated: ok {rc=0} 16:30:32.956463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24614): Launched 16:30:33.254154 run osmo-hlr_10.42.42.2(pid=24615): Launched 16:30:33.366758 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:33.876755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24617): Launched 16:30:34.175718 run osmo-stp_10.42.42.5(pid=24618): Launched 16:30:34.289398 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:34.829840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24620): Launched 16:30:35.128356 run osmo-msc_10.42.42.6(pid=24621): Launched 16:30:35.295430 run osmo-stp_10.42.42.5(pid=24618): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24618)] 16:30:35.421870 run osmo-stp_10.42.42.5(pid=24618): stdout: | (launched: 2022-12-10_16:30:34.120209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:35.548641 run osmo-stp_10.42.42.5(pid=24618): stderr: | [0;m[38;5;43m20221210163034288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163034288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163034288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163034289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163034291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163034291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163034291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:35.674036 run osmo-stp_10.42.42.5(pid=24618): stdout: | (launched: 2022-12-10_16:30:34.120209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:35.793488 run osmo-stp_10.42.42.5(pid=24618): stderr: | [0;m[38;5;43m20221210163034288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163034288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163034288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163034289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163034291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163034291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163034291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:35.936003 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24618): Process ended prematurely: osmo-stp_10.42.42.5(pid=24618) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24618)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:30:35.944789 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:30:35.971991 run osmo-hlr_10.42.42.2(pid=24615): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24615)] 16:30:36.020085 run osmo-hlr_10.42.42.2(pid=24615): stdout: | (launched: 2022-12-10_16:30:33.199425) 16:30:36.070070 run osmo-hlr_10.42.42.2(pid=24615): stderr: | [0;m[1;31m20221210163033375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163033375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163033375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163033375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163033375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163033375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163033387 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163033396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163033396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163033396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:36.140160 run osmo-msc_10.42.42.6(pid=24621): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24621)] 16:30:36.188222 run osmo-msc_10.42.42.6(pid=24621): stdout: | (launched: 2022-12-10_16:30:35.073153) 16:30:36.238063 run osmo-msc_10.42.42.6(pid=24621): stderr: | [0;m[38;5;43m20221210163035346 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163035347 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa15d2aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163035347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163035347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163035347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163035347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163035351 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163035352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163035352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163035352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:36.288304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24614): Terminating (SIGTERM) 16:30:36.328570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24617): Terminating (SIGTERM) 16:30:36.369458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24620): Terminating (SIGTERM) 16:30:36.410034 --- ParallelTerminationStrategy: PID 24614 died... 16:30:36.429313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24614): Terminated: ok {rc=0} 16:30:36.474307 --- ParallelTerminationStrategy: PID 24617 died... 16:30:36.493352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24617): Terminated: ok {rc=0} 16:30:36.538193 --- ParallelTerminationStrategy: PID 24620 died... 16:30:36.557084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24620): Terminated: ok {rc=0} 16:30:36.643672 bus /sierra_3: Setting Powered False 16:30:37.743526 bus /sierra_3: Setting Powered False 16:30:38.860069 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:30:40.106840 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:30:40.113576 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:30:40.143350 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:30:40.169921 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:30:40.222554 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:30:40.252698 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:30:40.279084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:30:40.829521 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:30:40.877778 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:40.889066 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:30:40.954222 tst mo_mt_call.py: using LAC 29216 16:30:41.071972 tst mo_mt_call.py: using RAC 146 16:30:41.190012 tst mo_mt_call.py: using CellId 29216 16:30:41.308789 tst mo_mt_call.py: using BVCI 29217 16:30:41.416389 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:41.427671 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:41.438652 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:41.450028 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:41.461351 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:41.472630 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:30:41.591483 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:30:41.707224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:42.170704 run create_hlr_db(pid=24626): Launched 16:30:42.284179 bus /sierra_2: Setting Powered False 16:30:43.345100 run create_hlr_db(pid=24626): Terminated: ok {rc=0} 16:30:43.763715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24628): Launched 16:30:44.063747 run osmo-hlr_10.42.42.2(pid=24629): Launched 16:30:44.178170 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:44.705314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24631): Launched 16:30:45.004102 run osmo-stp_10.42.42.5(pid=24632): Launched 16:30:45.116851 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:45.658190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24634): Launched 16:30:46.008888 run osmo-msc_10.42.42.6(pid=24635): Launched 16:30:46.311883 run osmo-stp_10.42.42.5(pid=24632): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24632)] 16:30:46.650608 run osmo-stp_10.42.42.5(pid=24632): stdout: | (launched: 2022-12-10_16:30:44.949320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:46.841462 run osmo-stp_10.42.42.5(pid=24632): stderr: | [0;m[38;5;43m20221210163045116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163045116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163045116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163045117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163045119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163045119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163045119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:46.973271 run osmo-stp_10.42.42.5(pid=24632): stdout: | (launched: 2022-12-10_16:30:44.949320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:47.096909 run osmo-stp_10.42.42.5(pid=24632): stderr: | [0;m[38;5;43m20221210163045116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163045116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163045116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163045117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163045119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163045119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163045119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:47.243631 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24632): Process ended prematurely: osmo-stp_10.42.42.5(pid=24632) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24632)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:30:47.253653 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:30:47.282670 run osmo-hlr_10.42.42.2(pid=24629): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24629)] 16:30:47.332491 run osmo-hlr_10.42.42.2(pid=24629): stdout: | (launched: 2022-12-10_16:30:44.008525) 16:30:47.383470 run osmo-hlr_10.42.42.2(pid=24629): stderr: | [0;m[1;31m20221210163044185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163044185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163044185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163044185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163044185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163044185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163044197 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163044206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163044206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163044206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:47.455187 run osmo-msc_10.42.42.6(pid=24635): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24635)] 16:30:47.503612 run osmo-msc_10.42.42.6(pid=24635): stdout: | (launched: 2022-12-10_16:30:45.934256) 16:30:47.553299 run osmo-msc_10.42.42.6(pid=24635): stderr: | [0;m[38;5;43m20221210163046415 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163046415 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0edf4eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163046415 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163046415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163046416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163046416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163046418 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163046419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163046419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163046419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:47.603032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24628): Terminating (SIGTERM) 16:30:47.643212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24631): Terminating (SIGTERM) 16:30:47.683248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24634): Terminating (SIGTERM) 16:30:47.723920 --- ParallelTerminationStrategy: PID 24628 died... 16:30:47.743305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24628): Terminated: ok {rc=0} 16:30:47.788219 --- ParallelTerminationStrategy: PID 24631 died... 16:30:47.807096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24631): Terminated: ok {rc=0} 16:30:47.851866 --- ParallelTerminationStrategy: PID 24634 died... 16:30:47.870684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24634): Terminated: ok {rc=0} 16:30:47.956593 bus /sierra_3: Setting Powered False 16:30:49.056677 bus /sierra_3: Setting Powered False 16:30:50.175000 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:30:51.320055 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:51.331813 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:30:51.397453 tst mo_mt_call_osmux.py: using LAC 29217 16:30:51.515145 tst mo_mt_call_osmux.py: using RAC 147 16:30:51.631660 tst mo_mt_call_osmux.py: using CellId 29217 16:30:51.749381 tst mo_mt_call_osmux.py: using BVCI 29218 16:30:51.856852 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:51.868212 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:51.879275 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:51.890740 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:51.902141 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:51.913427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:30:52.027307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:30:52.147704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:52.644828 run create_hlr_db(pid=24637): Launched 16:30:52.775100 bus /sierra_2: Setting Powered False 16:30:53.838471 run create_hlr_db(pid=24637): Terminated: ok {rc=0} 16:30:54.264639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24639): Launched 16:30:54.562364 run osmo-hlr_10.42.42.2(pid=24640): Launched 16:30:54.676801 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:55.206343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24642): Launched 16:30:55.504187 run osmo-stp_10.42.42.5(pid=24643): Launched 16:30:55.618234 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:56.171833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24645): Launched 16:30:56.469561 run osmo-msc_10.42.42.6(pid=24646): Launched 16:30:56.636766 run osmo-stp_10.42.42.5(pid=24643): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24643)] 16:30:56.763862 run osmo-stp_10.42.42.5(pid=24643): stdout: | (launched: 2022-12-10_16:30:55.449331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:56.891081 run osmo-stp_10.42.42.5(pid=24643): stderr: | [0;m[38;5;43m20221210163055619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163055620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163055620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163055620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163055622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163055623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163055623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:57.015077 run osmo-stp_10.42.42.5(pid=24643): stdout: | (launched: 2022-12-10_16:30:55.449331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:57.134220 run osmo-stp_10.42.42.5(pid=24643): stderr: | [0;m[38;5;43m20221210163055619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163055620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163055620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163055620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163055622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163055623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163055623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:57.276310 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24643): Process ended prematurely: osmo-stp_10.42.42.5(pid=24643) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24643)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:30:57.285076 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:30:57.311978 run osmo-hlr_10.42.42.2(pid=24640): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24640)] 16:30:57.360056 run osmo-hlr_10.42.42.2(pid=24640): stdout: | (launched: 2022-12-10_16:30:54.507267) 16:30:57.409369 run osmo-hlr_10.42.42.2(pid=24640): stderr: | [0;m[1;31m20221210163054685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163054685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163054685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163054685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163054685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163054685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163054701 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163054711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163054711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163054711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:57.478211 run osmo-msc_10.42.42.6(pid=24646): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24646)] 16:30:57.525531 run osmo-msc_10.42.42.6(pid=24646): stdout: | (launched: 2022-12-10_16:30:56.414267) 16:30:57.574693 run osmo-msc_10.42.42.6(pid=24646): stderr: | [0;m[38;5;43m20221210163056686 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163056687 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f36baac3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163056687 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163056687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163056687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163056687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163056689 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163056690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163056690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163056690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:57.624181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24639): Terminating (SIGTERM) 16:30:57.663511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24642): Terminating (SIGTERM) 16:30:57.702823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24645): Terminating (SIGTERM) 16:30:57.742566 --- ParallelTerminationStrategy: PID 24639 died... 16:30:57.760889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24639): Terminated: ok {rc=0} 16:30:57.805139 --- ParallelTerminationStrategy: PID 24642 died... 16:30:57.823460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24642): Terminated: ok {rc=0} 16:30:57.867559 --- ParallelTerminationStrategy: PID 24645 died... 16:30:57.886022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24645): Terminated: ok {rc=0} 16:30:57.969626 bus /sierra_3: Setting Powered False 16:30:59.065813 bus /sierra_3: Setting Powered False 16:31:00.180849 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:31:01.430777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:01.443048 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:31:01.476849 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:31:01.505697 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:31:01.560134 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:31:01.597915 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:31:01.629344 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:31:02.183501 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:31:02.235293 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:02.247913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:31:02.312456 tst mo_mt_call.py: using LAC 29218 16:31:02.428772 tst mo_mt_call.py: using RAC 148 16:31:02.545204 tst mo_mt_call.py: using CellId 29218 16:31:02.661427 tst mo_mt_call.py: using BVCI 29219 16:31:02.779532 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:02.791379 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:02.803084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:02.815214 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:02.827647 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:02.839946 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:31:02.957448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:31:03.076367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:03.572667 run create_hlr_db(pid=24651): Launched 16:31:03.703160 bus /sierra_2: Setting Powered False 16:31:04.766974 run create_hlr_db(pid=24651): Terminated: ok {rc=0} 16:31:05.212158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24653): Launched 16:31:05.532610 run osmo-hlr_10.42.42.2(pid=24654): Launched 16:31:05.654159 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:06.206979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24656): Launched 16:31:06.526729 run osmo-stp_10.42.42.5(pid=24657): Launched 16:31:06.647685 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:07.224266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24659): Launched 16:31:07.543952 run osmo-msc_10.42.42.6(pid=24660): Launched 16:31:07.717741 run osmo-stp_10.42.42.5(pid=24657): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24657)] 16:31:07.847514 run osmo-stp_10.42.42.5(pid=24657): stdout: | (launched: 2022-12-10_16:31:06.468066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:07.975995 run osmo-stp_10.42.42.5(pid=24657): stderr: | [0;m[38;5;43m20221210163106661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163106661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163106661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163106662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163106663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163106663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163106663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:08.101381 run osmo-stp_10.42.42.5(pid=24657): stdout: | (launched: 2022-12-10_16:31:06.468066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:08.221180 run osmo-stp_10.42.42.5(pid=24657): stderr: | [0;m[38;5;43m20221210163106661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163106661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163106661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163106662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163106663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163106663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163106663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:08.364337 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24657): Process ended prematurely: osmo-stp_10.42.42.5(pid=24657) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24657)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:31:08.373565 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:31:08.400796 run osmo-hlr_10.42.42.2(pid=24654): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24654)] 16:31:08.449328 run osmo-hlr_10.42.42.2(pid=24654): stdout: | (launched: 2022-12-10_16:31:05.473831) 16:31:08.499057 run osmo-hlr_10.42.42.2(pid=24654): stderr: | [0;m[1;31m20221210163105673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163105673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163105673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163105673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163105673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163105673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163105686 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163105694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163105694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163105694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:08.569139 run osmo-msc_10.42.42.6(pid=24660): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24660)] 16:31:08.617313 run osmo-msc_10.42.42.6(pid=24660): stdout: | (launched: 2022-12-10_16:31:07.485137) 16:31:08.667043 run osmo-msc_10.42.42.6(pid=24660): stderr: | [0;m[38;5;43m20221210163107756 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163107757 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c442dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163107757 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163107757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163107757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163107757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163107759 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163107759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163107759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163107759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:08.717256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24653): Terminating (SIGTERM) 16:31:08.757865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24656): Terminating (SIGTERM) 16:31:08.798344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24659): Terminating (SIGTERM) 16:31:08.839049 --- ParallelTerminationStrategy: PID 24653 died... 16:31:08.858396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24653): Terminated: ok {rc=0} 16:31:08.903797 --- ParallelTerminationStrategy: PID 24656 died... 16:31:08.922712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24656): Terminated: ok {rc=0} 16:31:08.967558 --- ParallelTerminationStrategy: PID 24659 died... 16:31:08.986402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24659): Terminated: ok {rc=0} 16:31:09.072725 bus /sierra_3: Setting Powered False 16:31:10.171755 bus /sierra_3: Setting Powered False 16:31:11.287792 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:31:12.437839 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:12.450315 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:31:12.517290 tst mo_mt_call_osmux.py: using LAC 29219 16:31:12.636817 tst mo_mt_call_osmux.py: using RAC 149 16:31:12.755322 tst mo_mt_call_osmux.py: using CellId 29219 16:31:12.872681 tst mo_mt_call_osmux.py: using BVCI 29220 16:31:12.990420 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:13.002409 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:13.014314 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:13.026172 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:13.039186 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:13.051490 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:31:13.168130 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:31:13.282595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:13.745979 run create_hlr_db(pid=24662): Launched 16:31:13.860478 bus /sierra_2: Setting Powered False 16:31:14.920754 run create_hlr_db(pid=24662): Terminated: ok {rc=0} 16:31:15.338306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24664): Launched 16:31:15.636935 run osmo-hlr_10.42.42.2(pid=24665): Launched 16:31:15.750704 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:16.384742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24667): Launched 16:31:16.709755 run osmo-stp_10.42.42.5(pid=24668): Launched 16:31:16.940768 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:17.575853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24670): Launched 16:31:17.875782 run osmo-msc_10.42.42.6(pid=24671): Launched 16:31:18.042076 run osmo-stp_10.42.42.5(pid=24668): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24668)] 16:31:18.168470 run osmo-stp_10.42.42.5(pid=24668): stdout: | (launched: 2022-12-10_16:31:16.639140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:18.295510 run osmo-stp_10.42.42.5(pid=24668): stderr: | [0;m[38;5;43m20221210163116898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163116898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163116898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163116899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163116899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163116899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163116899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:18.420167 run osmo-stp_10.42.42.5(pid=24668): stdout: | (launched: 2022-12-10_16:31:16.639140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:18.539390 run osmo-stp_10.42.42.5(pid=24668): stderr: | [0;m[38;5;43m20221210163116898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163116898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163116898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163116899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163116899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163116899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163116899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:18.682544 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24668): Process ended prematurely: osmo-stp_10.42.42.5(pid=24668) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24668)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:31:18.691726 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:31:18.719035 run osmo-hlr_10.42.42.2(pid=24665): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24665)] 16:31:18.767786 run osmo-hlr_10.42.42.2(pid=24665): stdout: | (launched: 2022-12-10_16:31:15.581647) 16:31:18.817778 run osmo-hlr_10.42.42.2(pid=24665): stderr: | [0;m[1;31m20221210163115757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163115757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163115757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163115757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163115757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163115757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163115769 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163115778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163115778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163115778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:18.887687 run osmo-msc_10.42.42.6(pid=24671): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24671)] 16:31:18.936066 run osmo-msc_10.42.42.6(pid=24671): stdout: | (launched: 2022-12-10_16:31:17.819430) 16:31:18.985676 run osmo-msc_10.42.42.6(pid=24671): stderr: | [0;m[38;5;43m20221210163118091 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163118091 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe7dda64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163118091 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163118091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163118092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163118092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163118094 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163118095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163118095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163118095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:19.035666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24664): Terminating (SIGTERM) 16:31:19.075628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24667): Terminating (SIGTERM) 16:31:19.115589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24670): Terminating (SIGTERM) 16:31:19.156038 --- ParallelTerminationStrategy: PID 24664 died... 16:31:19.175251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24664): Terminated: ok {rc=0} 16:31:19.220592 --- ParallelTerminationStrategy: PID 24667 died... 16:31:19.239626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24667): Terminated: ok {rc=0} 16:31:19.284585 --- ParallelTerminationStrategy: PID 24670 died... 16:31:19.303686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24670): Terminated: ok {rc=0} 16:31:19.390703 bus /sierra_3: Setting Powered False 16:31:20.489330 bus /sierra_3: Setting Powered False 16:31:21.604929 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:31:22.851449 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:22.858060 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:31:22.888247 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:31:22.915203 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:31:22.966065 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:31:22.995054 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:31:23.021132 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:31:23.577316 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:31:23.626165 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:23.637664 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:31:23.702607 tst mo_mt_call.py: using LAC 29220 16:31:23.819683 tst mo_mt_call.py: using RAC 150 16:31:23.946034 tst mo_mt_call.py: using CellId 29220 16:31:24.071524 tst mo_mt_call.py: using BVCI 29221 16:31:24.182013 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:24.193456 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:24.204636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:24.216318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:24.227896 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:24.239359 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:31:24.357227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:31:24.473396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:24.935856 run create_hlr_db(pid=24676): Launched 16:31:25.049879 bus /sierra_2: Setting Powered False 16:31:26.110201 run create_hlr_db(pid=24676): Terminated: ok {rc=0} 16:31:26.549807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Launched 16:31:26.870032 run osmo-hlr_10.42.42.2(pid=24679): Launched 16:31:26.992599 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:27.542225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Launched 16:31:27.861260 run osmo-stp_10.42.42.5(pid=24682): Launched 16:31:27.982438 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:28.560411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24684): Launched 16:31:28.880323 run osmo-msc_10.42.42.6(pid=24685): Launched 16:31:29.058556 run osmo-stp_10.42.42.5(pid=24682): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] 16:31:29.192686 run osmo-stp_10.42.42.5(pid=24682): stdout: | (launched: 2022-12-10_16:31:27.802488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:29.327659 run osmo-stp_10.42.42.5(pid=24682): stderr: | [0;m[38;5;43m20221210163127998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163127998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163127998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163127999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163127999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163127999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163127999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:29.461562 run osmo-stp_10.42.42.5(pid=24682): stdout: | (launched: 2022-12-10_16:31:27.802488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:29.588577 run osmo-stp_10.42.42.5(pid=24682): stderr: | [0;m[38;5;43m20221210163127998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163127998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163127998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163127999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163127999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163127999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163127999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:29.740546 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24682): Process ended prematurely: osmo-stp_10.42.42.5(pid=24682) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:31:29.750236 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:31:29.777828 run osmo-hlr_10.42.42.2(pid=24679): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24679)] 16:31:29.827352 run osmo-hlr_10.42.42.2(pid=24679): stdout: | (launched: 2022-12-10_16:31:26.811399) 16:31:29.878639 run osmo-hlr_10.42.42.2(pid=24679): stderr: | [0;m[1;31m20221210163127011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163127011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163127011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163127011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163127011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163127011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163127027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163127037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163127038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163127038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:29.950145 run osmo-msc_10.42.42.6(pid=24685): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24685)] 16:31:29.999573 run osmo-msc_10.42.42.6(pid=24685): stdout: | (launched: 2022-12-10_16:31:28.821488) 16:31:30.050692 run osmo-msc_10.42.42.6(pid=24685): stderr: | [0;m[38;5;43m20221210163129144 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163129144 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0bc838ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163129144 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163129144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163129145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163129145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163129146 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163129147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163129147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163129147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:30.102199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Terminating (SIGTERM) 16:31:30.143496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Terminating (SIGTERM) 16:31:30.184615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24684): Terminating (SIGTERM) 16:31:30.226527 --- ParallelTerminationStrategy: PID 24678 died... 16:31:30.246132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Terminated: ok {rc=0} 16:31:30.292100 --- ParallelTerminationStrategy: PID 24681 died... 16:31:30.311649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Terminated: ok {rc=0} 16:31:30.357387 --- ParallelTerminationStrategy: PID 24684 died... 16:31:30.376875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24684): Terminated: ok {rc=0} 16:31:30.463608 bus /sierra_3: Setting Powered False 16:31:31.565805 bus /sierra_3: Setting Powered False 16:31:32.689302 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:31:33.837999 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:33.850284 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:31:33.919549 tst mo_mt_call_osmux.py: using LAC 29221 16:31:34.045488 tst mo_mt_call_osmux.py: using RAC 151 16:31:34.170215 tst mo_mt_call_osmux.py: using CellId 29221 16:31:34.300494 tst mo_mt_call_osmux.py: using BVCI 29222 16:31:34.417112 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:34.428844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:34.440470 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:34.452034 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:34.463665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:34.475202 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:31:34.589633 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:31:34.707355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:35.203677 run create_hlr_db(pid=24687): Launched 16:31:35.333307 bus /sierra_2: Setting Powered False 16:31:36.396468 run create_hlr_db(pid=24687): Terminated: ok {rc=0} 16:31:36.842659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Launched 16:31:37.163713 run osmo-hlr_10.42.42.2(pid=24690): Launched 16:31:37.285259 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:37.837239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Launched 16:31:38.156267 run osmo-stp_10.42.42.5(pid=24693): Launched 16:31:38.277473 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:38.854913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24695): Launched 16:31:39.177292 run osmo-msc_10.42.42.6(pid=24696): Launched 16:31:39.356110 run osmo-stp_10.42.42.5(pid=24693): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] 16:31:39.490870 run osmo-stp_10.42.42.5(pid=24693): stdout: | (launched: 2022-12-10_16:31:38.097765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:39.626218 run osmo-stp_10.42.42.5(pid=24693): stderr: | [0;m[38;5;43m20221210163138290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163138291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163138291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163138291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163138292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163138292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163138292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:39.760706 run osmo-stp_10.42.42.5(pid=24693): stdout: | (launched: 2022-12-10_16:31:38.097765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:39.888450 run osmo-stp_10.42.42.5(pid=24693): stderr: | [0;m[38;5;43m20221210163138290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163138291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163138291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163138291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163138292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163138292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163138292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:40.042932 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24693): Process ended prematurely: osmo-stp_10.42.42.5(pid=24693) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:31:40.052459 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:31:40.080526 run osmo-hlr_10.42.42.2(pid=24690): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24690)] 16:31:40.130717 run osmo-hlr_10.42.42.2(pid=24690): stdout: | (launched: 2022-12-10_16:31:37.104770) 16:31:40.183253 run osmo-hlr_10.42.42.2(pid=24690): stderr: | [0;m[1;31m20221210163137304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163137304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163137304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163137304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163137304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163137304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163137316 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163137325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163137325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163137325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:40.255820 run osmo-msc_10.42.42.6(pid=24696): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24696)] 16:31:40.305837 run osmo-msc_10.42.42.6(pid=24696): stdout: | (launched: 2022-12-10_16:31:39.118594) 16:31:40.357342 run osmo-msc_10.42.42.6(pid=24696): stderr: | [0;m[38;5;43m20221210163139440 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163139440 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8ef4664c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163139440 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163139440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163139440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163139440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163139442 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163139443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163139443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163139443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:40.409206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Terminating (SIGTERM) 16:31:40.450936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Terminating (SIGTERM) 16:31:40.492603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24695): Terminating (SIGTERM) 16:31:40.534802 --- ParallelTerminationStrategy: PID 24689 died... 16:31:40.554987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Terminated: ok {rc=0} 16:31:40.601701 --- ParallelTerminationStrategy: PID 24692 died... 16:31:40.621489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Terminated: ok {rc=0} 16:31:40.667760 --- ParallelTerminationStrategy: PID 24695 died... 16:31:40.687612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24695): Terminated: ok {rc=0} 16:31:40.776091 bus /sierra_3: Setting Powered False 16:31:41.875155 bus /sierra_3: Setting Powered False 16:31:42.992646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:31:44.243287 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:44.251168 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:31:44.281548 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:31:44.308236 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:31:44.366136 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:31:44.395728 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:31:44.422156 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:31:44.974664 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:31:45.026248 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:45.038659 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:31:45.107514 tst mo_mt_call.py: using LAC 29222 16:31:45.233319 tst mo_mt_call.py: using RAC 152 16:31:45.361013 tst mo_mt_call.py: using CellId 29222 16:31:45.486263 tst mo_mt_call.py: using BVCI 29223 16:31:45.603225 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:45.615157 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:45.626785 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:45.638697 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:45.650555 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:45.662389 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:31:45.776876 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:31:45.907415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:46.410849 run create_hlr_db(pid=24701): Launched 16:31:46.560162 bus /sierra_2: Setting Powered False 16:31:47.624211 run create_hlr_db(pid=24701): Terminated: ok {rc=0} 16:31:48.072179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24703): Launched 16:31:48.392003 run osmo-hlr_10.42.42.2(pid=24704): Launched 16:31:48.512579 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:49.063102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24706): Launched 16:31:49.383924 run osmo-stp_10.42.42.5(pid=24707): Launched 16:31:49.504428 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:50.080211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24709): Launched 16:31:50.399952 run osmo-msc_10.42.42.6(pid=24710): Launched 16:31:50.576627 run osmo-stp_10.42.42.5(pid=24707): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24707)] 16:31:50.714393 run osmo-stp_10.42.42.5(pid=24707): stdout: | (launched: 2022-12-10_16:31:49.325209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:50.850520 run osmo-stp_10.42.42.5(pid=24707): stderr: | [0;m[38;5;43m20221210163149517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163149517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163149517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163149518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163149518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163149518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163149518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:50.983122 run osmo-stp_10.42.42.5(pid=24707): stdout: | (launched: 2022-12-10_16:31:49.325209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:51.110882 run osmo-stp_10.42.42.5(pid=24707): stderr: | [0;m[38;5;43m20221210163149517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163149517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163149517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163149518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163149518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163149518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163149518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:51.263713 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24707): Process ended prematurely: osmo-stp_10.42.42.5(pid=24707) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24707)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:31:51.273348 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:31:51.301330 run osmo-hlr_10.42.42.2(pid=24704): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24704)] 16:31:51.351513 run osmo-hlr_10.42.42.2(pid=24704): stdout: | (launched: 2022-12-10_16:31:48.333432) 16:31:51.403459 run osmo-hlr_10.42.42.2(pid=24704): stderr: | [0;m[1;31m20221210163148532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163148532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163148532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163148532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163148532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163148532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163148546 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163148556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163148557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163148557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:51.475903 run osmo-msc_10.42.42.6(pid=24710): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24710)] 16:31:51.525639 run osmo-msc_10.42.42.6(pid=24710): stdout: | (launched: 2022-12-10_16:31:50.341535) 16:31:51.577232 run osmo-msc_10.42.42.6(pid=24710): stderr: | [0;m[38;5;43m20221210163150667 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163150667 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b63ae8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163150667 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163150667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163150667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163150667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163150669 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163150670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163150670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163150670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:51.629256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24703): Terminating (SIGTERM) 16:31:51.670899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24706): Terminating (SIGTERM) 16:31:51.712409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24709): Terminating (SIGTERM) 16:31:51.754658 --- ParallelTerminationStrategy: PID 24703 died... 16:31:51.774692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24703): Terminated: ok {rc=0} 16:31:51.821191 --- ParallelTerminationStrategy: PID 24706 died... 16:31:51.840694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24706): Terminated: ok {rc=0} 16:31:51.886845 --- ParallelTerminationStrategy: PID 24709 died... 16:31:51.906568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24709): Terminated: ok {rc=0} 16:31:51.992932 bus /sierra_3: Setting Powered False 16:31:53.090962 bus /sierra_3: Setting Powered False 16:31:54.205444 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:31:55.351284 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:55.363223 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:31:55.430295 tst mo_mt_call_osmux.py: using LAC 29223 16:31:55.549792 tst mo_mt_call_osmux.py: using RAC 153 16:31:55.667476 tst mo_mt_call_osmux.py: using CellId 29223 16:31:55.788077 tst mo_mt_call_osmux.py: using BVCI 29224 16:31:55.897671 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:55.909007 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:55.920235 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:55.931540 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:55.942992 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:31:55.954616 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:31:56.069282 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:31:56.186860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:56.682106 run create_hlr_db(pid=24712): Launched 16:31:56.811813 bus /sierra_2: Setting Powered False 16:31:57.875667 run create_hlr_db(pid=24712): Terminated: ok {rc=0} 16:31:58.302401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24714): Launched 16:31:58.600670 run osmo-hlr_10.42.42.2(pid=24715): Launched 16:31:58.713847 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:59.228250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24717): Launched 16:31:59.526420 run osmo-stp_10.42.42.5(pid=24718): Launched 16:31:59.638903 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:00.176447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24720): Launched 16:32:00.475230 run osmo-msc_10.42.42.6(pid=24721): Launched 16:32:00.640422 run osmo-stp_10.42.42.5(pid=24718): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24718)] 16:32:00.766125 run osmo-stp_10.42.42.5(pid=24718): stdout: | (launched: 2022-12-10_16:31:59.470765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:00.929747 run osmo-stp_10.42.42.5(pid=24718): stderr: | [0;m[38;5;43m20221210163159641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163159641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163159641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163159641 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163159644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163159644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163159644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:01.091895 run osmo-stp_10.42.42.5(pid=24718): stdout: | (launched: 2022-12-10_16:31:59.470765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:01.225700 run osmo-stp_10.42.42.5(pid=24718): stderr: | [0;m[38;5;43m20221210163159641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163159641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163159641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163159641 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163159644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163159644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163159644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:01.383474 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24718): Process ended prematurely: osmo-stp_10.42.42.5(pid=24718) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24718)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:32:01.393636 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:32:01.423055 run osmo-hlr_10.42.42.2(pid=24715): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24715)] 16:32:01.473853 run osmo-hlr_10.42.42.2(pid=24715): stdout: | (launched: 2022-12-10_16:31:58.545360) 16:32:01.526516 run osmo-hlr_10.42.42.2(pid=24715): stderr: | [0;m[1;31m20221210163158722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163158722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163158722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163158722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163158722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163158722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163158755 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163158765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163158766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163158766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:01.602168 run osmo-msc_10.42.42.6(pid=24721): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24721)] 16:32:01.653284 run osmo-msc_10.42.42.6(pid=24721): stdout: | (launched: 2022-12-10_16:32:00.419616) 16:32:01.706580 run osmo-msc_10.42.42.6(pid=24721): stderr: | [0;m[38;5;43m20221210163200692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163200692 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1555ca4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163200692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163200692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163200692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163200693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163200696 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163200697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163200697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163200697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:01.760781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24714): Terminating (SIGTERM) 16:32:01.804899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24717): Terminating (SIGTERM) 16:32:01.849917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24720): Terminating (SIGTERM) 16:32:01.895309 --- ParallelTerminationStrategy: PID 24714 died... 16:32:01.916763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24714): Terminated: ok {rc=0} 16:32:01.966808 --- ParallelTerminationStrategy: PID 24717 died... 16:32:01.987495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24717): Terminated: ok {rc=0} 16:32:02.035426 --- ParallelTerminationStrategy: PID 24720 died... 16:32:02.056252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24720): Terminated: ok {rc=0} 16:32:02.145788 bus /sierra_3: Setting Powered False 16:32:03.244253 bus /sierra_3: Setting Powered False 16:32:04.357867 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:32:05.609832 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:32:05.616122 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:32:05.646190 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:32:05.674519 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:32:05.727279 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:32:05.757498 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:32:05.784693 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:32:06.336043 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:32:06.388257 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:06.399991 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:32:06.471447 tst mo_mt_call.py: using LAC 29224 16:32:06.596870 tst mo_mt_call.py: using RAC 154 16:32:06.719909 tst mo_mt_call.py: using CellId 29224 16:32:06.843362 tst mo_mt_call.py: using BVCI 29225 16:32:06.958760 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:06.970523 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:06.981906 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:06.993282 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:07.004597 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:07.015996 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:32:07.131038 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:32:07.244235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:07.707718 run create_hlr_db(pid=24726): Launched 16:32:07.822428 bus /sierra_2: Setting Powered False 16:32:08.882825 run create_hlr_db(pid=24726): Terminated: ok {rc=0} 16:32:09.321795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24728): Launched 16:32:09.641711 run osmo-hlr_10.42.42.2(pid=24729): Launched 16:32:09.762898 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:10.311983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24731): Launched 16:32:10.631063 run osmo-stp_10.42.42.5(pid=24732): Launched 16:32:10.751949 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:11.329411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24734): Launched 16:32:11.650342 run osmo-msc_10.42.42.6(pid=24735): Launched 16:32:11.827724 run osmo-stp_10.42.42.5(pid=24732): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24732)] 16:32:11.962420 run osmo-stp_10.42.42.5(pid=24732): stdout: | (launched: 2022-12-10_16:32:10.572721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:12.097432 run osmo-stp_10.42.42.5(pid=24732): stderr: | [0;m[38;5;43m20221210163210766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163210766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163210766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163210767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163210767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163210767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163210767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:12.231869 run osmo-stp_10.42.42.5(pid=24732): stdout: | (launched: 2022-12-10_16:32:10.572721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:12.359970 run osmo-stp_10.42.42.5(pid=24732): stderr: | [0;m[38;5;43m20221210163210766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163210766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163210766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163210767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163210767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163210767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163210767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:12.512888 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24732): Process ended prematurely: osmo-stp_10.42.42.5(pid=24732) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24732)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:32:12.522523 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:32:12.550936 run osmo-hlr_10.42.42.2(pid=24729): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24729)] 16:32:12.601289 run osmo-hlr_10.42.42.2(pid=24729): stdout: | (launched: 2022-12-10_16:32:09.583097) 16:32:12.653546 run osmo-hlr_10.42.42.2(pid=24729): stderr: | [0;m[1;31m20221210163209783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163209783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163209783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163209783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163209783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163209783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163209836 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163209846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163209846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163209846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:12.726278 run osmo-msc_10.42.42.6(pid=24735): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24735)] 16:32:12.776593 run osmo-msc_10.42.42.6(pid=24735): stdout: | (launched: 2022-12-10_16:32:11.591450) 16:32:12.828232 run osmo-msc_10.42.42.6(pid=24735): stderr: | [0;m[38;5;43m20221210163211915 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163211915 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faff57b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163211915 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163211915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163211915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163211915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163211917 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163211917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163211917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163211918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:12.880462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24728): Terminating (SIGTERM) 16:32:12.922481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24731): Terminating (SIGTERM) 16:32:12.964455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24734): Terminating (SIGTERM) 16:32:13.007006 --- ParallelTerminationStrategy: PID 24728 died... 16:32:13.027159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24728): Terminated: ok {rc=0} 16:32:13.074102 --- ParallelTerminationStrategy: PID 24731 died... 16:32:13.093732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24731): Terminated: ok {rc=0} 16:32:13.140718 --- ParallelTerminationStrategy: PID 24734 died... 16:32:13.160649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24734): Terminated: ok {rc=0} 16:32:13.248770 bus /sierra_3: Setting Powered False 16:32:14.350061 bus /sierra_3: Setting Powered False 16:32:15.464752 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:32:16.613445 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:16.626501 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:32:16.697659 tst mo_mt_call_osmux.py: using LAC 29225 16:32:16.852266 tst mo_mt_call_osmux.py: using RAC 155 16:32:16.980568 tst mo_mt_call_osmux.py: using CellId 29225 16:32:17.107367 tst mo_mt_call_osmux.py: using BVCI 29226 16:32:17.219687 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:17.232411 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:17.244018 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:17.255961 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:17.267927 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:17.279077 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:32:17.398752 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:32:17.519230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:18.015700 run create_hlr_db(pid=24737): Launched 16:32:18.145422 bus /sierra_2: Setting Powered False 16:32:19.206107 run create_hlr_db(pid=24737): Terminated: ok {rc=0} 16:32:19.651035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24739): Launched 16:32:19.971425 run osmo-hlr_10.42.42.2(pid=24740): Launched 16:32:20.092902 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:20.640773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24742): Launched 16:32:20.959077 run osmo-stp_10.42.42.5(pid=24743): Launched 16:32:21.080155 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:21.656722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24745): Launched 16:32:21.976340 run osmo-msc_10.42.42.6(pid=24746): Launched 16:32:22.154496 run osmo-stp_10.42.42.5(pid=24743): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24743)] 16:32:22.289319 run osmo-stp_10.42.42.5(pid=24743): stdout: | (launched: 2022-12-10_16:32:20.900521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:22.424029 run osmo-stp_10.42.42.5(pid=24743): stderr: | [0;m[38;5;43m20221210163221092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163221093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163221093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163221093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163221094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163221094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163221094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:22.558680 run osmo-stp_10.42.42.5(pid=24743): stdout: | (launched: 2022-12-10_16:32:20.900521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:22.686558 run osmo-stp_10.42.42.5(pid=24743): stderr: | [0;m[38;5;43m20221210163221092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163221093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163221093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163221093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163221094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163221094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163221094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:22.838992 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24743): Process ended prematurely: osmo-stp_10.42.42.5(pid=24743) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24743)] [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:32:22.848445 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:32:22.876719 run osmo-hlr_10.42.42.2(pid=24740): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24740)] 16:32:22.926536 run osmo-hlr_10.42.42.2(pid=24740): stdout: | (launched: 2022-12-10_16:32:19.912652) 16:32:22.978226 run osmo-hlr_10.42.42.2(pid=24740): stderr: | [0;m[1;31m20221210163220109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163220110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163220110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163220110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163220110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163220110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163220122 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163220130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163220130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163220130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:23.050396 run osmo-msc_10.42.42.6(pid=24746): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24746)] 16:32:23.100228 run osmo-msc_10.42.42.6(pid=24746): stdout: | (launched: 2022-12-10_16:32:21.917730) 16:32:23.151641 run osmo-msc_10.42.42.6(pid=24746): stderr: | [0;m[38;5;43m20221210163222240 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163222240 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0440c5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163222240 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163222240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163222240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163222240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163222242 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163222242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163222243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163222243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:23.203024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24739): Terminating (SIGTERM) 16:32:23.244883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24742): Terminating (SIGTERM) 16:32:23.286485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24745): Terminating (SIGTERM) 16:32:23.328433 --- ParallelTerminationStrategy: PID 24739 died... 16:32:23.348781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24739): Terminated: ok {rc=0} 16:32:23.396174 --- ParallelTerminationStrategy: PID 24742 died... 16:32:23.415768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24742): Terminated: ok {rc=0} 16:32:23.461571 --- ParallelTerminationStrategy: PID 24745 died... 16:32:23.481001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24745): Terminated: ok {rc=0} 16:32:23.567982 bus /sierra_3: Setting Powered False 16:32:24.664068 bus /sierra_3: Setting Powered False 16:32:25.777490 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 16:32:27.021367 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:32:27.025875 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:32:27.055811 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:32:27.082177 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 16:32:27.165481 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:32:27.194621 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:32:27.221245 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 16:32:27.806069 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2376 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 16:32:27.811348 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:27.822393 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:32:27.868810 tst emergency_mo_mt_call.py: using LAC 29226 16:32:27.984059 tst emergency_mo_mt_call.py: using RAC 156 16:32:28.099735 tst emergency_mo_mt_call.py: using CellId 29226 16:32:28.214181 tst emergency_mo_mt_call.py: using BVCI 29227 16:32:28.322385 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:28.333258 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:28.343866 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:28.354856 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:28.365418 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:28.376669 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:28.493775 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:28.606317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:29.061470 run create_hlr_db(pid=24752): Launched 16:32:29.173415 bus /sierra_2: Setting Powered False 16:32:30.232478 run create_hlr_db(pid=24752): Terminated: ok {rc=0} 16:32:30.663588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24754): Launched 16:32:30.993661 run osmo-hlr_10.42.42.2(pid=24755): Launched 16:32:31.256604 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:31.865884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24757): Launched 16:32:32.181497 run osmo-stp_10.42.42.5(pid=24758): Launched 16:32:32.419863 tst emergency_mo_mt_call.py: using MSISDN 7794 16:32:32.581166 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:33.149594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24760): Launched 16:32:33.465639 run osmo-msc_10.42.42.6(pid=24761): Launched 16:32:33.639060 run osmo-stp_10.42.42.5(pid=24758): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24758)] 16:32:33.771350 run osmo-stp_10.42.42.5(pid=24758): stdout: | (launched: 2022-12-10_16:32:32.116529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:33.903318 run osmo-stp_10.42.42.5(pid=24758): stderr: | [0;m[38;5;43m20221210163232335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163232335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163232335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163232336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163232336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163232336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163232336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:34.034947 run osmo-stp_10.42.42.5(pid=24758): stdout: | (launched: 2022-12-10_16:32:32.116529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:34.159893 run osmo-stp_10.42.42.5(pid=24758): stderr: | [0;m[38;5;43m20221210163232335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163232335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163232335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163232336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163232336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163232336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163232336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:34.310272 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24758): Process ended prematurely: osmo-stp_10.42.42.5(pid=24758) [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24758)] [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 16:32:34.318964 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 16:32:34.346693 run osmo-hlr_10.42.42.2(pid=24755): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24755)] 16:32:34.396768 run osmo-hlr_10.42.42.2(pid=24755): stdout: | (launched: 2022-12-10_16:32:30.925093) 16:32:34.448550 run osmo-hlr_10.42.42.2(pid=24755): stderr: | [0;m[1;31m20221210163231282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163231282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163231282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163231282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163231282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163231282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163231306 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163231324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163231324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163231324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:34.520420 run osmo-msc_10.42.42.6(pid=24761): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24761)] 16:32:34.570545 run osmo-msc_10.42.42.6(pid=24761): stdout: | (launched: 2022-12-10_16:32:33.407404) 16:32:34.621835 run osmo-msc_10.42.42.6(pid=24761): stderr: | [0;m[38;5;43m20221210163233731 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163233732 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f046d6c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163233732 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163233732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163233732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163233732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163233734 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163233735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163233735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163233735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:34.673540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24754): Terminating (SIGTERM) 16:32:34.714906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24757): Terminating (SIGTERM) 16:32:34.756379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24760): Terminating (SIGTERM) 16:32:34.798364 --- ParallelTerminationStrategy: PID 24754 died... 16:32:34.818449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24754): Terminated: ok {rc=0} 16:32:34.864529 --- ParallelTerminationStrategy: PID 24757 died... 16:32:34.884173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24757): Terminated: ok {rc=0} 16:32:34.930147 --- ParallelTerminationStrategy: PID 24760 died... 16:32:34.949785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24760): Terminated: ok {rc=0} 16:32:35.035692 bus /sierra_3: Setting Powered False 16:32:36.133143 bus /sierra_3: Setting Powered False 16:32:37.247553 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 16:32:38.334101 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:38.345598 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:32:38.392845 tst emergency_preemptive_call.py: using LAC 29227 16:32:38.507076 tst emergency_preemptive_call.py: using RAC 157 16:32:38.622053 tst emergency_preemptive_call.py: using CellId 29227 16:32:38.741905 tst emergency_preemptive_call.py: using BVCI 29228 16:32:38.849834 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:38.861060 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:38.871568 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:38.882459 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:38.893298 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:38.903964 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:39.019906 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:39.135899 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:39.256592 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:39.374132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:39.862308 run create_hlr_db(pid=24765): Launched 16:32:39.990230 bus /sierra_2: Setting Powered False 16:32:41.052604 run create_hlr_db(pid=24765): Terminated: ok {rc=0} 16:32:41.491451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24767): Launched 16:32:41.805011 run osmo-hlr_10.42.42.2(pid=24768): Launched 16:32:41.923665 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:42.467354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24770): Launched 16:32:42.780352 run osmo-stp_10.42.42.5(pid=24771): Launched 16:32:42.912469 tst emergency_preemptive_call.py: using MSISDN 7795 16:32:43.073837 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:43.638669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24773): Launched 16:32:43.951192 run osmo-msc_10.42.42.6(pid=24774): Launched 16:32:44.125977 run osmo-stp_10.42.42.5(pid=24771): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24771)] 16:32:44.259395 run osmo-stp_10.42.42.5(pid=24771): stdout: | (launched: 2022-12-10_16:32:42.722674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:44.393111 run osmo-stp_10.42.42.5(pid=24771): stderr: | [0;m[38;5;43m20221210163242912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163242913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163242913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163242913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163242916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163242916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163242916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:44.525138 run osmo-stp_10.42.42.5(pid=24771): stdout: | (launched: 2022-12-10_16:32:42.722674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:44.650408 run osmo-stp_10.42.42.5(pid=24771): stderr: | [0;m[38;5;43m20221210163242912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163242913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163242913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163242913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163242916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163242916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163242916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:44.799970 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24771): Process ended prematurely: osmo-stp_10.42.42.5(pid=24771) [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24771)] [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 16:32:44.808748 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 16:32:44.836121 run osmo-hlr_10.42.42.2(pid=24768): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24768)] 16:32:44.885966 run osmo-hlr_10.42.42.2(pid=24768): stdout: | (launched: 2022-12-10_16:32:41.747140) 16:32:44.937684 run osmo-hlr_10.42.42.2(pid=24768): stderr: | [0;m[1;31m20221210163241947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163241947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163241947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163241947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163241947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163241947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163241962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163241971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163241972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163241972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:45.010140 run osmo-msc_10.42.42.6(pid=24774): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24774)] 16:32:45.059909 run osmo-msc_10.42.42.6(pid=24774): stdout: | (launched: 2022-12-10_16:32:43.893476) 16:32:45.111218 run osmo-msc_10.42.42.6(pid=24774): stderr: | [0;m[38;5;43m20221210163244212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163244212 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe83b7c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163244212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163244212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163244213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163244213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163244215 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163244215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163244215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163244215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:45.162893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24767): Terminating (SIGTERM) 16:32:45.204428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24770): Terminating (SIGTERM) 16:32:45.246292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24773): Terminating (SIGTERM) 16:32:45.288168 --- ParallelTerminationStrategy: PID 24767 died... 16:32:45.308401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24767): Terminated: ok {rc=0} 16:32:45.354704 --- ParallelTerminationStrategy: PID 24770 died... 16:32:45.374284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24770): Terminated: ok {rc=0} 16:32:45.420683 --- ParallelTerminationStrategy: PID 24773 died... 16:32:45.440277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24773): Terminated: ok {rc=0} 16:32:45.527632 bus /sierra_9: Setting Powered False 16:32:46.625869 bus /sierra_9: Setting Powered False 16:32:47.744171 bus /sierra_8: Setting Powered False 16:32:48.842994 bus /sierra_8: Setting Powered False 16:32:49.957425 bus /sierra_3: Setting Powered False 16:32:51.055305 bus /sierra_3: Setting Powered False 16:32:52.171579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 16:32:53.442573 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:32:53.446979 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:32:53.476293 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 16:32:53.514406 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 16:32:53.599996 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:32:53.629092 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 16:32:53.667207 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 16:32:54.258814 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 16:32:54.308057 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:32:54.318882 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:32:54.366198 tst cs_paging_gprs_active.py: using LAC 29228 16:32:54.482957 tst cs_paging_gprs_active.py: using RAC 158 16:32:54.599169 tst cs_paging_gprs_active.py: using CellId 29228 16:32:54.716187 tst cs_paging_gprs_active.py: using BVCI 29229 16:32:54.824723 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:32:54.835626 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:32:54.846266 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:32:54.857123 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:32:54.867697 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:32:54.878354 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:32:54.889216 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:32:54.899864 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:32:54.910690 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:55.025599 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:55.140681 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:32:55.343237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:32:55.645285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24779): Launched 16:32:55.906954 run iperf3-srv_10.42.42.10(pid=24780): Launched 16:32:56.018791 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:32:56.219512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:32:56.520616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24781): Launched 16:32:56.782578 run iperf3-srv_10.42.42.10(pid=24782): Launched 16:32:56.894564 tst cs_paging_gprs_active.py:38: start network... 16:32:57.095293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:57.557120 run create_hlr_db(pid=24783): Launched 16:32:57.670929 bus /sierra_2: Setting Powered False 16:32:58.734719 run create_hlr_db(pid=24783): Terminated: ok {rc=0} 16:32:59.182269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24785): Launched 16:32:59.502591 run osmo-hlr_10.42.42.2(pid=24786): Launched 16:32:59.624651 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:00.174826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24788): Launched 16:33:00.494874 run osmo-stp_10.42.42.5(pid=24789): Launched 16:33:00.617127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:01.188376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24792): Launched 16:33:01.323974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:01.605596 run patchelf(pid=24793): Launched 16:33:01.801568 run osmo-stp_10.42.42.5(pid=24789): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24789)] 16:33:01.939438 run osmo-stp_10.42.42.5(pid=24789): stdout: | (launched: 2022-12-10_16:33:00.436275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:02.079744 run osmo-stp_10.42.42.5(pid=24789): stderr: | [0;m[38;5;43m20221210163300627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163300627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163300627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163300628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163300628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163300628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163300628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:02.219523 run osmo-stp_10.42.42.5(pid=24789): stdout: | (launched: 2022-12-10_16:33:00.436275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:02.351260 run osmo-stp_10.42.42.5(pid=24789): stderr: | [0;m[38;5;43m20221210163300627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163300627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163300627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163300628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163300628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163300628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163300628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:02.506668 run patchelf(pid=24793): Terminating (SIGINT) 16:33:02.687191 run patchelf(pid=24793): Terminated: ok {rc=0} 16:33:02.817384 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24789): Process ended prematurely: osmo-stp_10.42.42.5(pid=24789) [trial-2376↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24789)] [trial-2376↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 16:33:02.827546 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:33:02.856259 run osmo-hlr_10.42.42.2(pid=24786): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24786)] 16:33:02.906042 run osmo-hlr_10.42.42.2(pid=24786): stdout: | (launched: 2022-12-10_16:32:59.444011) 16:33:02.957385 run osmo-hlr_10.42.42.2(pid=24786): stderr: | [0;m[1;31m20221210163259643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163259643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163259643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163259644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163259644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163259644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163259655 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163259664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163259664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163259664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:03.009317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24779): Terminating (SIGTERM) 16:33:03.050833 run iperf3-srv_10.42.42.10(pid=24780): Terminating (SIGTERM) 16:33:03.092283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24781): Terminating (SIGTERM) 16:33:03.133903 run iperf3-srv_10.42.42.10(pid=24782): Terminating (SIGTERM) 16:33:03.175303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24785): Terminating (SIGTERM) 16:33:03.216833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24788): Terminating (SIGTERM) 16:33:03.258816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24792): Terminating (SIGTERM) 16:33:03.300796 --- ParallelTerminationStrategy: PID 24779 died... 16:33:03.320913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24779): Terminated: ok {rc=0} 16:33:03.367126 --- ParallelTerminationStrategy: PID 24780 died... 16:33:03.386637 run iperf3-srv_10.42.42.10(pid=24780): Terminated {rc=256} 16:33:03.432502 --- ParallelTerminationStrategy: PID 24781 died... 16:33:03.452145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24781): Terminated: ok {rc=0} 16:33:03.498559 --- ParallelTerminationStrategy: PID 24782 died... 16:33:03.517988 run iperf3-srv_10.42.42.10(pid=24782): Terminated {rc=256} 16:33:03.563828 --- ParallelTerminationStrategy: PID 24785 died... 16:33:03.583366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24785): Terminated: ok {rc=0} 16:33:03.629257 --- ParallelTerminationStrategy: PID 24788 died... 16:33:03.648717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24788): Terminated: ok {rc=0} 16:33:03.695450 --- ParallelTerminationStrategy: PID 24792 died... 16:33:03.715233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24792): Terminated: ok {rc=0} 16:33:03.802803 bus /gobi_0: Setting Powered False 16:33:04.902479 bus /gobi_0: Setting Powered False 16:33:06.017450 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 16:33:07.164894 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:07.176839 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:33:07.225432 tst iperf3.py: using LAC 29229 16:33:07.353397 tst iperf3.py: using RAC 159 16:33:07.479660 tst iperf3.py: using CellId 29229 16:33:07.606414 tst iperf3.py: using BVCI 29230 16:33:07.724442 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:07.735945 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:07.747204 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:07.758320 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:07.769251 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:07.780113 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:07.791260 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:07.802236 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:07.813350 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:07.930552 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:33:08.146340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:08.468463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Launched 16:33:08.746969 run iperf3-srv_10.42.42.10(pid=24795): Launched 16:33:08.866369 tst iperf3.py:8: start network... 16:33:09.081875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:09.578101 run create_hlr_db(pid=24796): Launched 16:33:09.707895 bus /gobi_6: Setting Powered False 16:33:10.772087 run create_hlr_db(pid=24796): Terminated: ok {rc=0} 16:33:11.216344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24798): Launched 16:33:11.537142 run osmo-hlr_10.42.42.2(pid=24799): Launched 16:33:11.658825 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:12.208538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24801): Launched 16:33:12.527840 run osmo-stp_10.42.42.5(pid=24802): Launched 16:33:12.649126 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:13.199011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24804): Launched 16:33:13.321789 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:13.591213 run patchelf(pid=24805): Launched 16:33:13.768932 run osmo-stp_10.42.42.5(pid=24802): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24802)] 16:33:13.904049 run osmo-stp_10.42.42.5(pid=24802): stdout: | (launched: 2022-12-10_16:33:12.468936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:14.041069 run osmo-stp_10.42.42.5(pid=24802): stderr: | [0;m[38;5;43m20221210163312660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163312660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163312661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163312661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163312664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163312664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163312664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:14.178089 run osmo-stp_10.42.42.5(pid=24802): stdout: | (launched: 2022-12-10_16:33:12.468936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:14.309898 run osmo-stp_10.42.42.5(pid=24802): stderr: | [0;m[38;5;43m20221210163312660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163312660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163312661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163312661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163312664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163312664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163312664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:14.464738 run patchelf(pid=24805): Terminating (SIGINT) 16:33:14.643678 run patchelf(pid=24805): Terminated: ok {rc=0} 16:33:14.772827 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24802): Process ended prematurely: osmo-stp_10.42.42.5(pid=24802) [trial-2376↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24802)] [trial-2376↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 16:33:14.782876 tst iperf3.py:8: Test FAILED (7.7 sec) 16:33:14.811388 run osmo-hlr_10.42.42.2(pid=24799): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24799)] 16:33:14.861212 run osmo-hlr_10.42.42.2(pid=24799): stdout: | (launched: 2022-12-10_16:33:11.478247) 16:33:14.912585 run osmo-hlr_10.42.42.2(pid=24799): stderr: | [0;m[1;31m20221210163311679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163311679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163311679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163311679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163311679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163311680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163311704 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163311715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163311715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163311715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:14.964452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Terminating (SIGTERM) 16:33:15.006020 run iperf3-srv_10.42.42.10(pid=24795): Terminating (SIGTERM) 16:33:15.047606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24798): Terminating (SIGTERM) 16:33:15.089259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24801): Terminating (SIGTERM) 16:33:15.130805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24804): Terminating (SIGTERM) 16:33:15.172715 --- ParallelTerminationStrategy: PID 24794 died... 16:33:15.192867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Terminated: ok {rc=0} 16:33:15.239243 --- ParallelTerminationStrategy: PID 24795 died... 16:33:15.259132 run iperf3-srv_10.42.42.10(pid=24795): Terminated {rc=256} 16:33:15.304894 --- ParallelTerminationStrategy: PID 24798 died... 16:33:15.324631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24798): Terminated: ok {rc=0} 16:33:15.370484 --- ParallelTerminationStrategy: PID 24801 died... 16:33:15.390073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24801): Terminated: ok {rc=0} 16:33:15.435967 --- ParallelTerminationStrategy: PID 24804 died... 16:33:15.455625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24804): Terminated: ok {rc=0} 16:33:15.542803 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 16:33:16.711784 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:16.726906 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:33:16.784680 tst iperf3m4.py: using LAC 29230 16:33:16.950776 tst iperf3m4.py: using RAC 160 16:33:17.104635 tst iperf3m4.py: using CellId 29230 16:33:17.229091 tst iperf3m4.py: using BVCI 29231 16:33:17.339444 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:17.350662 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:17.361722 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:17.373428 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:17.385201 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:17.396801 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:17.408638 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:17.420135 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:17.431698 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:17.546977 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:17.669189 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:17.785346 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:17.908657 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:33:18.124848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:18.446830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24806): Launched 16:33:18.726001 run iperf3-srv_10.42.42.10(pid=24807): Launched 16:33:18.845249 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:33:19.061350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:19.382990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24808): Launched 16:33:19.661617 run iperf3-srv_10.42.42.10(pid=24809): Launched 16:33:19.781599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:33:19.997895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:20.320093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24810): Launched 16:33:20.598095 run iperf3-srv_10.42.42.10(pid=24811): Launched 16:33:20.717453 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:33:20.932608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:21.254325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24812): Launched 16:33:21.533474 run iperf3-srv_10.42.42.10(pid=24813): Launched 16:33:21.653376 tst iperf3m4.py:8: start network... 16:33:21.869816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:22.366932 run create_hlr_db(pid=24814): Launched 16:33:22.495954 bus /gobi_6: Setting Powered False 16:33:23.560219 run create_hlr_db(pid=24814): Terminated: ok {rc=0} 16:33:24.006048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24816): Launched 16:33:24.326052 run osmo-hlr_10.42.42.2(pid=24817): Launched 16:33:24.447391 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:25.096281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24819): Launched 16:33:25.410040 run osmo-stp_10.42.42.5(pid=24820): Launched 16:33:25.528346 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:26.067834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24822): Launched 16:33:26.187749 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:26.453513 run patchelf(pid=24823): Launched 16:33:26.627359 run osmo-stp_10.42.42.5(pid=24820): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24820)] 16:33:26.760183 run osmo-stp_10.42.42.5(pid=24820): stdout: | (launched: 2022-12-10_16:33:25.352684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:26.894863 run osmo-stp_10.42.42.5(pid=24820): stderr: | [0;m[38;5;43m20221210163325539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163325539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163325540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163325540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163325541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163325541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163325541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:27.029572 run osmo-stp_10.42.42.5(pid=24820): stdout: | (launched: 2022-12-10_16:33:25.352684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:27.158095 run osmo-stp_10.42.42.5(pid=24820): stderr: | [0;m[38;5;43m20221210163325539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163325539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163325540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163325540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163325541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163325541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163325541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:27.310838 run patchelf(pid=24823): Terminating (SIGINT) 16:33:27.486914 run patchelf(pid=24823): Terminated: ok {rc=0} 16:33:27.613954 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24820): Process ended prematurely: osmo-stp_10.42.42.5(pid=24820) [trial-2376↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24820)] [trial-2376↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 16:33:27.623964 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:33:27.652591 run osmo-hlr_10.42.42.2(pid=24817): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24817)] 16:33:27.702275 run osmo-hlr_10.42.42.2(pid=24817): stdout: | (launched: 2022-12-10_16:33:24.267153) 16:33:27.753697 run osmo-hlr_10.42.42.2(pid=24817): stderr: | [0;m[1;31m20221210163324462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163324462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163324463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163324463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163324463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163324463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163324489 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163324500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163324500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163324500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:27.805446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24806): Terminating (SIGTERM) 16:33:27.847065 run iperf3-srv_10.42.42.10(pid=24807): Terminating (SIGTERM) 16:33:27.889234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24808): Terminating (SIGTERM) 16:33:27.930875 run iperf3-srv_10.42.42.10(pid=24809): Terminating (SIGTERM) 16:33:27.972456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24810): Terminating (SIGTERM) 16:33:28.013988 run iperf3-srv_10.42.42.10(pid=24811): Terminating (SIGTERM) 16:33:28.055433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24812): Terminating (SIGTERM) 16:33:28.096822 run iperf3-srv_10.42.42.10(pid=24813): Terminating (SIGTERM) 16:33:28.138998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24816): Terminating (SIGTERM) 16:33:28.180470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24819): Terminating (SIGTERM) 16:33:28.221921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24822): Terminating (SIGTERM) 16:33:28.264117 --- ParallelTerminationStrategy: PID 24806 died... 16:33:28.284135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24806): Terminated: ok {rc=0} 16:33:28.330625 --- ParallelTerminationStrategy: PID 24807 died... 16:33:28.350285 run iperf3-srv_10.42.42.10(pid=24807): Terminated {rc=256} 16:33:28.396036 --- ParallelTerminationStrategy: PID 24808 died... 16:33:28.415477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24808): Terminated: ok {rc=0} 16:33:28.461882 --- ParallelTerminationStrategy: PID 24809 died... 16:33:28.481459 run iperf3-srv_10.42.42.10(pid=24809): Terminated {rc=256} 16:33:28.527231 --- ParallelTerminationStrategy: PID 24810 died... 16:33:28.546883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24810): Terminated: ok {rc=0} 16:33:28.592690 --- ParallelTerminationStrategy: PID 24811 died... 16:33:28.612264 run iperf3-srv_10.42.42.10(pid=24811): Terminated {rc=256} 16:33:28.658101 --- ParallelTerminationStrategy: PID 24812 died... 16:33:28.677542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24812): Terminated: ok {rc=0} 16:33:28.723249 --- ParallelTerminationStrategy: PID 24813 died... 16:33:28.742873 run iperf3-srv_10.42.42.10(pid=24813): Terminated {rc=256} 16:33:28.788749 --- ParallelTerminationStrategy: PID 24816 died... 16:33:28.808411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24816): Terminated: ok {rc=0} 16:33:28.854212 --- ParallelTerminationStrategy: PID 24819 died... 16:33:28.873408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24819): Terminated: ok {rc=0} 16:33:28.919318 --- ParallelTerminationStrategy: PID 24822 died... 16:33:28.938695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24822): Terminated: ok {rc=0} 16:33:29.025843 bus /gobi_4: Setting Powered False 16:33:30.124493 bus /gobi_4: Setting Powered False 16:33:31.242585 bus /gobi_1: Setting Powered False 16:33:32.348082 bus /gobi_1: Setting Powered False 16:33:33.462940 bus /gobi_0: Setting Powered False 16:33:34.560399 bus /gobi_0: Setting Powered False 16:33:35.675075 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 16:33:36.778208 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:36.789616 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:33:36.835233 tst ping.py: using LAC 29231 16:33:36.950645 tst ping.py: using RAC 161 16:33:37.065152 tst ping.py: using CellId 29231 16:33:37.181397 tst ping.py: using BVCI 29232 16:33:37.294924 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:37.306284 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:37.317674 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:37.329541 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:37.341095 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:37.352809 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:37.364628 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:37.376245 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:37.491677 tst ping.py:19: start network... 16:33:37.684729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:38.130702 run create_hlr_db(pid=24824): Launched 16:33:38.241473 bus /gobi_6: Setting Powered False 16:33:39.299603 run create_hlr_db(pid=24824): Terminated: ok {rc=0} 16:33:39.722707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24826): Launched 16:33:40.031994 run osmo-hlr_10.42.42.2(pid=24827): Launched 16:33:40.148912 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:40.684722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24829): Launched 16:33:40.993640 run osmo-stp_10.42.42.5(pid=24830): Launched 16:33:41.111379 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:41.646019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24832): Launched 16:33:41.763075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:42.023506 run patchelf(pid=24833): Launched 16:33:42.193982 run osmo-stp_10.42.42.5(pid=24830): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24830)] 16:33:42.325035 run osmo-stp_10.42.42.5(pid=24830): stdout: | (launched: 2022-12-10_16:33:40.936740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:42.457223 run osmo-stp_10.42.42.5(pid=24830): stderr: | [0;m[38;5;43m20221210163341126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163341126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163341126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163341127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163341129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163341129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163341129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:42.589777 run osmo-stp_10.42.42.5(pid=24830): stdout: | (launched: 2022-12-10_16:33:40.936740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:42.716193 run osmo-stp_10.42.42.5(pid=24830): stderr: | [0;m[38;5;43m20221210163341126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163341126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163341126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163341127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163341129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163341129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163341129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:42.865833 run patchelf(pid=24833): Terminating (SIGINT) 16:33:43.038683 run patchelf(pid=24833): Terminated: ok {rc=0} 16:33:43.163313 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24830): Process ended prematurely: osmo-stp_10.42.42.5(pid=24830) [trial-2376↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24830)] [trial-2376↪gprs:trx-lms-limenet-micro↪ping.py:22] 16:33:43.172604 tst ping.py:22: Test FAILED (6.4 sec) 16:33:43.200220 run osmo-hlr_10.42.42.2(pid=24827): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24827)] 16:33:43.249817 run osmo-hlr_10.42.42.2(pid=24827): stdout: | (launched: 2022-12-10_16:33:39.975615) 16:33:43.301549 run osmo-hlr_10.42.42.2(pid=24827): stderr: | [0;m[1;31m20221210163340173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163340173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163340173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163340173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163340173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163340173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163340185 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163340193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163340194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163340194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:43.353455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24826): Terminating (SIGTERM) 16:33:43.395008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24829): Terminating (SIGTERM) 16:33:43.436714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24832): Terminating (SIGTERM) 16:33:43.479186 --- ParallelTerminationStrategy: PID 24826 died... 16:33:43.499210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24826): Terminated: ok {rc=0} 16:33:43.545343 --- ParallelTerminationStrategy: PID 24829 died... 16:33:43.564640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24829): Terminated: ok {rc=0} 16:33:43.610402 --- ParallelTerminationStrategy: PID 24832 died... 16:33:43.629888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24832): Terminated: ok {rc=0} 16:33:43.716273 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 16:33:44.803290 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:44.815609 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:33:44.863335 tst ping_idle_ping.py: using LAC 29232 16:33:44.988561 tst ping_idle_ping.py: using RAC 162 16:33:45.111844 tst ping_idle_ping.py: using CellId 29232 16:33:45.232458 tst ping_idle_ping.py: using BVCI 29233 16:33:45.340548 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:45.351542 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:45.362404 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:45.374087 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:45.385553 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:45.396847 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:45.408437 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:45.419791 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:45.533858 tst ping_idle_ping.py:24: start network... 16:33:45.744414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:46.231086 run create_hlr_db(pid=24834): Launched 16:33:46.393244 bus /gobi_6: Setting Powered False 16:33:47.454480 run create_hlr_db(pid=24834): Terminated: ok {rc=0} 16:33:47.886578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24836): Launched 16:33:48.196757 run osmo-hlr_10.42.42.2(pid=24837): Launched 16:33:48.314711 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:48.846899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24839): Launched 16:33:49.156467 run osmo-stp_10.42.42.5(pid=24840): Launched 16:33:49.273914 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:49.809652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24842): Launched 16:33:49.927435 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:50.189761 run patchelf(pid=24843): Launched 16:33:50.361405 run osmo-stp_10.42.42.5(pid=24840): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24840)] 16:33:50.492121 run osmo-stp_10.42.42.5(pid=24840): stdout: | (launched: 2022-12-10_16:33:49.098867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:50.625025 run osmo-stp_10.42.42.5(pid=24840): stderr: | [0;m[38;5;43m20221210163349290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163349290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163349290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163349291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163349291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163349291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163349291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:50.757745 run osmo-stp_10.42.42.5(pid=24840): stdout: | (launched: 2022-12-10_16:33:49.098867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:50.884463 run osmo-stp_10.42.42.5(pid=24840): stderr: | [0;m[38;5;43m20221210163349290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163349290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163349290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163349291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163349291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163349291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163349291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:51.034997 run patchelf(pid=24843): Terminating (SIGINT) 16:33:51.207814 run patchelf(pid=24843): Terminated: ok {rc=0} 16:33:51.333532 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24840): Process ended prematurely: osmo-stp_10.42.42.5(pid=24840) [trial-2376↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24840)] [trial-2376↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 16:33:51.342740 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:33:51.370404 run osmo-hlr_10.42.42.2(pid=24837): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24837)] 16:33:51.419810 run osmo-hlr_10.42.42.2(pid=24837): stdout: | (launched: 2022-12-10_16:33:48.139885) 16:33:51.470828 run osmo-hlr_10.42.42.2(pid=24837): stderr: | [0;m[1;31m20221210163348336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163348336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163348336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163348336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163348337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163348337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163348354 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163348365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163348365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163348365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:51.523117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24836): Terminating (SIGTERM) 16:33:51.564452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24839): Terminating (SIGTERM) 16:33:51.605986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24842): Terminating (SIGTERM) 16:33:51.647588 --- ParallelTerminationStrategy: PID 24836 died... 16:33:51.667484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24836): Terminated: ok {rc=0} 16:33:51.713432 --- ParallelTerminationStrategy: PID 24839 died... 16:33:51.733102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24839): Terminated: ok {rc=0} 16:33:51.778832 --- ParallelTerminationStrategy: PID 24842 died... 16:33:51.798169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24842): Terminated: ok {rc=0} 16:33:51.884463 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 16:33:53.185739 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:33:53.191441 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:33:53.221217 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:33:53.260376 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:33:53.349345 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:33:53.378975 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:33:53.417741 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:33:54.015340 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:33:54.066418 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:33:54.078027 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:33:54.125766 tst cs_paging_gprs_active.py: using LAC 29233 16:33:54.253995 tst cs_paging_gprs_active.py: using RAC 163 16:33:54.377194 tst cs_paging_gprs_active.py: using CellId 29233 16:33:54.499426 tst cs_paging_gprs_active.py: using BVCI 29234 16:33:54.613545 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:33:54.625137 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:33:54.636523 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:33:54.647769 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:33:54.658953 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:33:54.670290 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:33:54.681640 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:33:54.692788 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:33:54.704370 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:33:54.819517 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:33:54.935371 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:33:55.136492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:55.434824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24847): Launched 16:33:55.693148 run iperf3-srv_10.42.42.10(pid=24848): Launched 16:33:55.803948 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:33:56.002568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:56.300461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24849): Launched 16:33:56.558631 run iperf3-srv_10.42.42.10(pid=24850): Launched 16:33:56.677445 tst cs_paging_gprs_active.py:38: start network... 16:33:56.890932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:57.380466 run create_hlr_db(pid=24851): Launched 16:33:57.509006 bus /gobi_6: Setting Powered False 16:33:58.572236 run create_hlr_db(pid=24851): Terminated: ok {rc=0} 16:33:59.010480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24853): Launched 16:33:59.324912 run osmo-hlr_10.42.42.2(pid=24854): Launched 16:33:59.444330 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:59.984912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24856): Launched 16:34:00.300143 run osmo-stp_10.42.42.5(pid=24857): Launched 16:34:00.421593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:00.985667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24859): Launched 16:34:01.117272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:01.390016 run patchelf(pid=24860): Launched 16:34:01.567785 run osmo-stp_10.42.42.5(pid=24857): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24857)] 16:34:01.698334 run osmo-stp_10.42.42.5(pid=24857): stdout: | (launched: 2022-12-10_16:34:00.242028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:01.831094 run osmo-stp_10.42.42.5(pid=24857): stderr: | [0;m[38;5;43m20221210163400434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163400434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163400434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163400435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163400435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163400435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163400435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:01.965367 run osmo-stp_10.42.42.5(pid=24857): stdout: | (launched: 2022-12-10_16:34:00.242028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:02.092581 run osmo-stp_10.42.42.5(pid=24857): stderr: | [0;m[38;5;43m20221210163400434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163400434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163400434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163400435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163400435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163400435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163400435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:02.242344 run patchelf(pid=24860): Terminating (SIGINT) 16:34:02.413513 run patchelf(pid=24860): Terminated: ok {rc=0} 16:34:02.536098 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24857): Process ended prematurely: osmo-stp_10.42.42.5(pid=24857) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24857)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:34:02.545951 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:34:02.575161 run osmo-hlr_10.42.42.2(pid=24854): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24854)] 16:34:02.624320 run osmo-hlr_10.42.42.2(pid=24854): stdout: | (launched: 2022-12-10_16:33:59.266776) 16:34:02.675107 run osmo-hlr_10.42.42.2(pid=24854): stderr: | [0;m[1;31m20221210163359465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163359465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163359465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163359465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163359465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163359465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163359478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163359486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163359486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163359486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:02.726132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24847): Terminating (SIGTERM) 16:34:02.767009 run iperf3-srv_10.42.42.10(pid=24848): Terminating (SIGTERM) 16:34:02.807723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24849): Terminating (SIGTERM) 16:34:02.848583 run iperf3-srv_10.42.42.10(pid=24850): Terminating (SIGTERM) 16:34:02.888304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24853): Terminating (SIGTERM) 16:34:02.930197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24856): Terminating (SIGTERM) 16:34:02.970877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24859): Terminating (SIGTERM) 16:34:03.011765 --- ParallelTerminationStrategy: PID 24847 died... 16:34:03.030896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24847): Terminated: ok {rc=0} 16:34:03.076851 --- ParallelTerminationStrategy: PID 24848 died... 16:34:03.095546 run iperf3-srv_10.42.42.10(pid=24848): Terminated {rc=256} 16:34:03.141030 --- ParallelTerminationStrategy: PID 24849 died... 16:34:03.159730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24849): Terminated: ok {rc=0} 16:34:03.205566 --- ParallelTerminationStrategy: PID 24850 died... 16:34:03.224042 run iperf3-srv_10.42.42.10(pid=24850): Terminated {rc=256} 16:34:03.269651 --- ParallelTerminationStrategy: PID 24853 died... 16:34:03.288465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24853): Terminated: ok {rc=0} 16:34:03.334193 --- ParallelTerminationStrategy: PID 24856 died... 16:34:03.353050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24856): Terminated: ok {rc=0} 16:34:03.399034 --- ParallelTerminationStrategy: PID 24859 died... 16:34:03.417743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24859): Terminated: ok {rc=0} 16:34:03.506217 bus /gobi_0: Setting Powered False 16:34:04.604733 bus /gobi_0: Setting Powered False 16:34:05.719584 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:34:06.868700 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:06.880849 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:34:06.929114 tst iperf3.py: using LAC 29234 16:34:07.054471 tst iperf3.py: using RAC 164 16:34:07.178410 tst iperf3.py: using CellId 29234 16:34:07.304014 tst iperf3.py: using BVCI 29235 16:34:07.418495 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:07.430267 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:07.441767 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:07.453195 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:07.464532 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:07.476151 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:07.487680 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:07.498976 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:07.510631 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:07.629532 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:34:07.842427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:08.160376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24861): Launched 16:34:08.435643 run iperf3-srv_10.42.42.10(pid=24862): Launched 16:34:08.553706 tst iperf3.py:8: start network... 16:34:08.766125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:09.252301 run create_hlr_db(pid=24863): Launched 16:34:09.381746 bus /gobi_6: Setting Powered False 16:34:10.444519 run create_hlr_db(pid=24863): Terminated: ok {rc=0} 16:34:10.866461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24865): Launched 16:34:11.161678 run osmo-hlr_10.42.42.2(pid=24866): Launched 16:34:11.273989 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:11.796646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24868): Launched 16:34:12.091419 run osmo-stp_10.42.42.5(pid=24869): Launched 16:34:12.203099 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:12.709547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24871): Launched 16:34:12.822344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:13.071768 run patchelf(pid=24872): Launched 16:34:13.235403 run osmo-stp_10.42.42.5(pid=24869): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24869)] 16:34:13.360302 run osmo-stp_10.42.42.5(pid=24869): stdout: | (launched: 2022-12-10_16:34:12.037112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:13.487201 run osmo-stp_10.42.42.5(pid=24869): stderr: | [0;m[38;5;43m20221210163412208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163412208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163412209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163412209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163412209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163412209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163412209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:13.613672 run osmo-stp_10.42.42.5(pid=24869): stdout: | (launched: 2022-12-10_16:34:12.037112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:13.734507 run osmo-stp_10.42.42.5(pid=24869): stderr: | [0;m[38;5;43m20221210163412208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163412208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163412209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163412209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163412209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163412209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163412209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:13.877519 run patchelf(pid=24872): Terminating (SIGINT) 16:34:14.043278 run patchelf(pid=24872): Terminated: ok {rc=0} 16:34:14.163124 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24869): Process ended prematurely: osmo-stp_10.42.42.5(pid=24869) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24869)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 16:34:14.172468 tst iperf3.py:8: Test FAILED (7.3 sec) 16:34:14.199847 run osmo-hlr_10.42.42.2(pid=24866): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24866)] 16:34:14.247757 run osmo-hlr_10.42.42.2(pid=24866): stdout: | (launched: 2022-12-10_16:34:11.107409) 16:34:14.297340 run osmo-hlr_10.42.42.2(pid=24866): stderr: | [0;m[1;31m20221210163411279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163411279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163411279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163411279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163411279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163411279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163411295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163411305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163411305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163411305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:14.347023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24861): Terminating (SIGTERM) 16:34:14.387027 run iperf3-srv_10.42.42.10(pid=24862): Terminating (SIGTERM) 16:34:14.426909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24865): Terminating (SIGTERM) 16:34:14.466870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24868): Terminating (SIGTERM) 16:34:14.506763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24871): Terminating (SIGTERM) 16:34:14.546837 --- ParallelTerminationStrategy: PID 24861 died... 16:34:14.565870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24861): Terminated: ok {rc=0} 16:34:14.610397 --- ParallelTerminationStrategy: PID 24862 died... 16:34:14.628812 run iperf3-srv_10.42.42.10(pid=24862): Terminated {rc=256} 16:34:14.673299 --- ParallelTerminationStrategy: PID 24865 died... 16:34:14.691640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24865): Terminated: ok {rc=0} 16:34:14.735946 --- ParallelTerminationStrategy: PID 24868 died... 16:34:14.754358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24868): Terminated: ok {rc=0} 16:34:14.798231 --- ParallelTerminationStrategy: PID 24871 died... 16:34:14.816661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24871): Terminated: ok {rc=0} 16:34:14.902822 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:34:16.064843 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:16.077887 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:34:16.127506 tst iperf3m4.py: using LAC 29235 16:34:16.257015 tst iperf3m4.py: using RAC 165 16:34:16.422305 tst iperf3m4.py: using CellId 29235 16:34:16.547062 tst iperf3m4.py: using BVCI 29236 16:34:16.658814 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:16.671541 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:16.683572 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:16.696795 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:16.711124 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:16.724365 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:16.736306 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:16.749675 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:16.764128 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:16.887768 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:17.005231 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:17.139072 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:17.260471 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:34:17.461056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:17.759802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24874): Launched 16:34:18.017992 run iperf3-srv_10.42.42.10(pid=24875): Launched 16:34:18.128813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:34:18.327576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:18.624355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24876): Launched 16:34:18.882548 run iperf3-srv_10.42.42.10(pid=24877): Launched 16:34:18.993061 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:34:19.191410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:19.489123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24878): Launched 16:34:19.746804 run iperf3-srv_10.42.42.10(pid=24879): Launched 16:34:19.857181 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:34:20.054614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:20.351443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24880): Launched 16:34:20.608158 run iperf3-srv_10.42.42.10(pid=24881): Launched 16:34:20.718186 tst iperf3m4.py:8: start network... 16:34:20.915134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:21.370682 run create_hlr_db(pid=24882): Launched 16:34:21.483164 bus /gobi_6: Setting Powered False 16:34:22.542638 run create_hlr_db(pid=24882): Terminated: ok {rc=0} 16:34:22.956149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24885): Launched 16:34:23.271317 run osmo-hlr_10.42.42.2(pid=24886): Launched 16:34:23.391757 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:23.934315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24888): Launched 16:34:24.248245 run osmo-stp_10.42.42.5(pid=24889): Launched 16:34:24.368584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:24.909898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24891): Launched 16:34:25.030295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:25.296743 run patchelf(pid=24892): Launched 16:34:25.471566 run osmo-stp_10.42.42.5(pid=24889): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24889)] 16:34:25.604911 run osmo-stp_10.42.42.5(pid=24889): stdout: | (launched: 2022-12-10_16:34:24.190737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:25.740213 run osmo-stp_10.42.42.5(pid=24889): stderr: | [0;m[38;5;43m20221210163424380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163424381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163424381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163424381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163424382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163424382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163424382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:25.875530 run osmo-stp_10.42.42.5(pid=24889): stdout: | (launched: 2022-12-10_16:34:24.190737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:26.004521 run osmo-stp_10.42.42.5(pid=24889): stderr: | [0;m[38;5;43m20221210163424380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163424381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163424381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163424381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163424382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163424382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163424382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:26.157667 run patchelf(pid=24892): Terminating (SIGINT) 16:34:26.334610 run patchelf(pid=24892): Terminated: ok {rc=0} 16:34:26.461846 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24889): Process ended prematurely: osmo-stp_10.42.42.5(pid=24889) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24889)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 16:34:26.471976 tst iperf3m4.py:8: Test FAILED (10.4 sec) 16:34:26.500583 run osmo-hlr_10.42.42.2(pid=24886): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24886)] 16:34:26.550346 run osmo-hlr_10.42.42.2(pid=24886): stdout: | (launched: 2022-12-10_16:34:23.213913) 16:34:26.601897 run osmo-hlr_10.42.42.2(pid=24886): stderr: | [0;m[1;31m20221210163423409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163423409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163423409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163423409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163423409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163423409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163423421 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163423430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163423430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163423430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:26.653516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24874): Terminating (SIGTERM) 16:34:26.695086 run iperf3-srv_10.42.42.10(pid=24875): Terminating (SIGTERM) 16:34:26.736795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24876): Terminating (SIGTERM) 16:34:26.778699 run iperf3-srv_10.42.42.10(pid=24877): Terminating (SIGTERM) 16:34:26.820434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24878): Terminating (SIGTERM) 16:34:26.862179 run iperf3-srv_10.42.42.10(pid=24879): Terminating (SIGTERM) 16:34:26.903529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24880): Terminating (SIGTERM) 16:34:26.945307 run iperf3-srv_10.42.42.10(pid=24881): Terminating (SIGTERM) 16:34:26.986785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24885): Terminating (SIGTERM) 16:34:27.028926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24888): Terminating (SIGTERM) 16:34:27.070629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24891): Terminating (SIGTERM) 16:34:27.112762 --- ParallelTerminationStrategy: PID 24874 died... 16:34:27.132770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24874): Terminated: ok {rc=0} 16:34:27.179017 --- ParallelTerminationStrategy: PID 24875 died... 16:34:27.198367 run iperf3-srv_10.42.42.10(pid=24875): Terminated {rc=256} 16:34:27.244234 --- ParallelTerminationStrategy: PID 24876 died... 16:34:27.263685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24876): Terminated: ok {rc=0} 16:34:27.310011 --- ParallelTerminationStrategy: PID 24877 died... 16:34:27.329416 run iperf3-srv_10.42.42.10(pid=24877): Terminated {rc=256} 16:34:27.375517 --- ParallelTerminationStrategy: PID 24878 died... 16:34:27.395314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24878): Terminated: ok {rc=0} 16:34:27.441180 --- ParallelTerminationStrategy: PID 24879 died... 16:34:27.460318 run iperf3-srv_10.42.42.10(pid=24879): Terminated {rc=256} 16:34:27.507279 --- ParallelTerminationStrategy: PID 24880 died... 16:34:27.526687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24880): Terminated: ok {rc=0} 16:34:27.572409 --- ParallelTerminationStrategy: PID 24881 died... 16:34:27.591951 run iperf3-srv_10.42.42.10(pid=24881): Terminated {rc=256} 16:34:27.637640 --- ParallelTerminationStrategy: PID 24885 died... 16:34:27.656933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24885): Terminated: ok {rc=0} 16:34:27.702542 --- ParallelTerminationStrategy: PID 24888 died... 16:34:27.721993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24888): Terminated: ok {rc=0} 16:34:27.767934 --- ParallelTerminationStrategy: PID 24891 died... 16:34:27.787485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24891): Terminated: ok {rc=0} 16:34:27.873871 bus /gobi_4: Setting Powered False 16:34:28.973358 bus /gobi_4: Setting Powered False 16:34:30.090541 bus /gobi_1: Setting Powered False 16:34:31.196799 bus /gobi_1: Setting Powered False 16:34:32.313850 bus /gobi_0: Setting Powered False 16:34:33.411645 bus /gobi_0: Setting Powered False 16:34:34.530405 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 16:34:35.633432 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:35.645517 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:34:35.693358 tst ping.py: using LAC 29236 16:34:35.816409 tst ping.py: using RAC 166 16:34:35.940026 tst ping.py: using CellId 29236 16:34:36.061062 tst ping.py: using BVCI 29237 16:34:36.172898 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:36.184411 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:36.195684 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:36.207218 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:36.218443 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:36.229628 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:36.241021 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:36.252288 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:36.363828 tst ping.py:19: start network... 16:34:36.560056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:37.009623 run create_hlr_db(pid=24893): Launched 16:34:37.120255 bus /gobi_6: Setting Powered False 16:34:38.179240 run create_hlr_db(pid=24893): Terminated: ok {rc=0} 16:34:38.585715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24895): Launched 16:34:38.874962 run osmo-hlr_10.42.42.2(pid=24896): Launched 16:34:38.985533 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:39.502083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24898): Launched 16:34:39.790637 run osmo-stp_10.42.42.5(pid=24899): Launched 16:34:39.900271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:40.400646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24901): Launched 16:34:40.511424 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:40.755852 run patchelf(pid=24902): Launched 16:34:40.916407 run osmo-stp_10.42.42.5(pid=24899): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24899)] 16:34:41.039402 run osmo-stp_10.42.42.5(pid=24899): stdout: | (launched: 2022-12-10_16:34:39.737202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:41.164016 run osmo-stp_10.42.42.5(pid=24899): stderr: | [0;m[38;5;43m20221210163439906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163439906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163439906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163439906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163439907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163439907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163439907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:41.288655 run osmo-stp_10.42.42.5(pid=24899): stdout: | (launched: 2022-12-10_16:34:39.737202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:41.407573 run osmo-stp_10.42.42.5(pid=24899): stderr: | [0;m[38;5;43m20221210163439906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163439906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163439906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163439906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163439907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163439907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163439907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:41.548229 run patchelf(pid=24902): Terminating (SIGINT) 16:34:41.710517 run patchelf(pid=24902): Terminated: ok {rc=0} 16:34:41.828111 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24899): Process ended prematurely: osmo-stp_10.42.42.5(pid=24899) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24899)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 16:34:41.836902 tst ping.py:22: Test FAILED (6.2 sec) 16:34:41.863688 run osmo-hlr_10.42.42.2(pid=24896): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24896)] 16:34:41.911672 run osmo-hlr_10.42.42.2(pid=24896): stdout: | (launched: 2022-12-10_16:34:38.821328) 16:34:41.960845 run osmo-hlr_10.42.42.2(pid=24896): stderr: | [0;m[1;31m20221210163438998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163438998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163438998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163438998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163438998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163438998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163439009 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163439018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163439018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163439018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:42.010554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24895): Terminating (SIGTERM) 16:34:42.050330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24898): Terminating (SIGTERM) 16:34:42.090070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24901): Terminating (SIGTERM) 16:34:42.129989 --- ParallelTerminationStrategy: PID 24895 died... 16:34:42.148816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24895): Terminated: ok {rc=0} 16:34:42.194025 --- ParallelTerminationStrategy: PID 24898 died... 16:34:42.212615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24898): Terminated: ok {rc=0} 16:34:42.256818 --- ParallelTerminationStrategy: PID 24901 died... 16:34:42.275836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24901): Terminated: ok {rc=0} 16:34:42.361926 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:34:43.450108 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:43.462230 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:34:43.510698 tst ping_idle_ping.py: using LAC 29237 16:34:43.627424 tst ping_idle_ping.py: using RAC 167 16:34:43.743072 tst ping_idle_ping.py: using CellId 29237 16:34:43.857053 tst ping_idle_ping.py: using BVCI 29238 16:34:43.962755 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:43.973833 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:43.984480 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:43.995626 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:44.006797 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:44.018033 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:44.029255 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:44.040358 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:44.153517 tst ping_idle_ping.py:24: start network... 16:34:44.348623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:44.802258 run create_hlr_db(pid=24903): Launched 16:34:44.912645 bus /gobi_6: Setting Powered False 16:34:45.976832 run create_hlr_db(pid=24903): Terminated: ok {rc=0} 16:34:46.467920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24905): Launched 16:34:46.801051 run osmo-hlr_10.42.42.2(pid=24906): Launched 16:34:47.030500 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:47.597704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24908): Launched 16:34:47.907013 run osmo-stp_10.42.42.5(pid=24909): Launched 16:34:48.023828 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:48.559629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24911): Launched 16:34:48.677615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:48.938574 run patchelf(pid=24912): Launched 16:34:49.109997 run osmo-stp_10.42.42.5(pid=24909): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24909)] 16:34:49.241222 run osmo-stp_10.42.42.5(pid=24909): stdout: | (launched: 2022-12-10_16:34:47.850155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:49.374492 run osmo-stp_10.42.42.5(pid=24909): stderr: | [0;m[38;5;43m20221210163448041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163448042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163448042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163448042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163448043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163448043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163448043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:49.507072 run osmo-stp_10.42.42.5(pid=24909): stdout: | (launched: 2022-12-10_16:34:47.850155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:49.633963 run osmo-stp_10.42.42.5(pid=24909): stderr: | [0;m[38;5;43m20221210163448041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163448042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163448042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163448042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163448043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163448043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163448043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:49.784057 run patchelf(pid=24912): Terminating (SIGINT) 16:34:49.957484 run patchelf(pid=24912): Terminated: ok {rc=0} 16:34:50.082420 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24909): Process ended prematurely: osmo-stp_10.42.42.5(pid=24909) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24909)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 16:34:50.091973 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:34:50.119828 run osmo-hlr_10.42.42.2(pid=24906): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24906)] 16:34:50.169293 run osmo-hlr_10.42.42.2(pid=24906): stdout: | (launched: 2022-12-10_16:34:46.738808) 16:34:50.220532 run osmo-hlr_10.42.42.2(pid=24906): stderr: | [0;m[1;31m20221210163447047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163447047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163447047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163447047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163447047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163447047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163447066 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163447095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163447095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163447095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:50.272231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24905): Terminating (SIGTERM) 16:34:50.314276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24908): Terminating (SIGTERM) 16:34:50.356047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24911): Terminating (SIGTERM) 16:34:50.397837 --- ParallelTerminationStrategy: PID 24905 died... 16:34:50.417634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24905): Terminated: ok {rc=0} 16:34:50.463632 --- ParallelTerminationStrategy: PID 24908 died... 16:34:50.483120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24908): Terminated: ok {rc=0} 16:34:50.529305 --- ParallelTerminationStrategy: PID 24911 died... 16:34:50.548828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24911): Terminated: ok {rc=0} 16:34:50.635672 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:34:51.936070 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:34:51.942506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:34:51.973867 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:34:52.012693 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:34:52.100337 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:34:52.131321 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:34:52.169991 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:34:52.761898 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:34:52.811354 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:34:52.822525 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:34:52.888604 tst cs_paging_gprs_active.py: using LAC 29238 16:34:53.008650 tst cs_paging_gprs_active.py: using RAC 168 16:34:53.125386 tst cs_paging_gprs_active.py: using CellId 29238 16:34:53.244811 tst cs_paging_gprs_active.py: using BVCI 29239 16:34:53.352877 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:34:53.364212 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:34:53.375163 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:34:53.386940 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:34:53.398502 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:34:53.410149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:34:53.422110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:34:53.433775 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:34:53.445532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:34:53.562238 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:34:53.679974 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:34:53.895374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:54.214580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24916): Launched 16:34:54.491360 run iperf3-srv_10.42.42.10(pid=24917): Launched 16:34:54.610372 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:34:54.824331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:55.142421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24918): Launched 16:34:55.417924 run iperf3-srv_10.42.42.10(pid=24919): Launched 16:34:55.536118 tst cs_paging_gprs_active.py:38: start network... 16:34:55.748751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:56.237267 run create_hlr_db(pid=24920): Launched 16:34:56.366983 bus /gobi_6: Setting Powered False 16:34:57.430167 run create_hlr_db(pid=24920): Terminated: ok {rc=0} 16:34:57.871082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24922): Launched 16:34:58.187289 run osmo-hlr_10.42.42.2(pid=24923): Launched 16:34:58.307393 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:58.854119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24925): Launched 16:34:59.169164 run osmo-stp_10.42.42.5(pid=24926): Launched 16:34:59.289189 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:59.834148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24928): Launched 16:34:59.954851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:00.222190 run patchelf(pid=24929): Launched 16:35:00.398239 run osmo-stp_10.42.42.5(pid=24926): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24926)] 16:35:00.532156 run osmo-stp_10.42.42.5(pid=24926): stdout: | (launched: 2022-12-10_16:34:59.111368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:00.668861 run osmo-stp_10.42.42.5(pid=24926): stderr: | [0;m[38;5;43m20221210163459302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163459302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163459302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163459303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163459303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163459303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163459303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:00.804726 run osmo-stp_10.42.42.5(pid=24926): stdout: | (launched: 2022-12-10_16:34:59.111368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:00.958138 run osmo-stp_10.42.42.5(pid=24926): stderr: | [0;m[38;5;43m20221210163459302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163459302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163459302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163459303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163459303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163459303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163459303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:01.115309 run patchelf(pid=24929): Terminating (SIGINT) 16:35:01.298939 run patchelf(pid=24929): Terminated: ok {rc=0} 16:35:01.430675 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24926): Process ended prematurely: osmo-stp_10.42.42.5(pid=24926) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24926)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:35:01.441836 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:35:01.471835 run osmo-hlr_10.42.42.2(pid=24923): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24923)] 16:35:01.523088 run osmo-hlr_10.42.42.2(pid=24923): stdout: | (launched: 2022-12-10_16:34:58.129516) 16:35:01.575694 run osmo-hlr_10.42.42.2(pid=24923): stderr: | [0;m[1;31m20221210163458327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163458327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163458327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163458327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163458327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163458327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163458340 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163458350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163458351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163458351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:01.628580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24916): Terminating (SIGTERM) 16:35:01.671042 run iperf3-srv_10.42.42.10(pid=24917): Terminating (SIGTERM) 16:35:01.714960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24918): Terminating (SIGTERM) 16:35:01.757889 run iperf3-srv_10.42.42.10(pid=24919): Terminating (SIGTERM) 16:35:01.805722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24922): Terminating (SIGTERM) 16:35:01.849913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24925): Terminating (SIGTERM) 16:35:01.892441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24928): Terminating (SIGTERM) 16:35:01.935280 --- ParallelTerminationStrategy: PID 24916 died... 16:35:01.955378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24916): Terminated: ok {rc=0} 16:35:02.002341 --- ParallelTerminationStrategy: PID 24917 died... 16:35:02.022231 run iperf3-srv_10.42.42.10(pid=24917): Terminated {rc=256} 16:35:02.069130 --- ParallelTerminationStrategy: PID 24918 died... 16:35:02.089128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24918): Terminated: ok {rc=0} 16:35:02.136377 --- ParallelTerminationStrategy: PID 24919 died... 16:35:02.156205 run iperf3-srv_10.42.42.10(pid=24919): Terminated {rc=256} 16:35:02.202687 --- ParallelTerminationStrategy: PID 24922 died... 16:35:02.222548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24922): Terminated: ok {rc=0} 16:35:02.269148 --- ParallelTerminationStrategy: PID 24925 died... 16:35:02.288545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24925): Terminated: ok {rc=0} 16:35:02.334939 --- ParallelTerminationStrategy: PID 24928 died... 16:35:02.354497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24928): Terminated: ok {rc=0} 16:35:02.441309 bus /gobi_0: Setting Powered False 16:35:03.540526 bus /gobi_0: Setting Powered False 16:35:04.658756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:35:05.802985 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:05.814861 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:35:05.882601 tst iperf3.py: using LAC 29239 16:35:06.008819 tst iperf3.py: using RAC 169 16:35:06.134028 tst iperf3.py: using CellId 29239 16:35:06.254300 tst iperf3.py: using BVCI 29240 16:35:06.372110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:06.383851 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:06.395198 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:06.406791 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:06.418340 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:06.429831 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:06.441357 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:06.452663 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:06.463834 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:06.582431 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:35:06.796469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:07.114388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24933): Launched 16:35:07.389901 run iperf3-srv_10.42.42.10(pid=24934): Launched 16:35:07.508141 tst iperf3.py:8: start network... 16:35:07.721115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:08.209374 run create_hlr_db(pid=24935): Launched 16:35:08.338391 bus /gobi_6: Setting Powered False 16:35:09.401756 run create_hlr_db(pid=24935): Terminated: ok {rc=0} 16:35:09.824772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24937): Launched 16:35:10.120743 run osmo-hlr_10.42.42.2(pid=24938): Launched 16:35:10.233819 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:10.762322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24940): Launched 16:35:11.059112 run osmo-stp_10.42.42.5(pid=24941): Launched 16:35:11.172098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:11.682962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24943): Launched 16:35:11.797083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:12.049563 run patchelf(pid=24944): Launched 16:35:12.214342 run osmo-stp_10.42.42.5(pid=24941): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24941)] 16:35:12.340532 run osmo-stp_10.42.42.5(pid=24941): stdout: | (launched: 2022-12-10_16:35:11.003821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:12.468366 run osmo-stp_10.42.42.5(pid=24941): stderr: | [0;m[38;5;43m20221210163511175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163511175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163511175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163511176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163511176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163511176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163511176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:12.596632 run osmo-stp_10.42.42.5(pid=24941): stdout: | (launched: 2022-12-10_16:35:11.003821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:12.719086 run osmo-stp_10.42.42.5(pid=24941): stderr: | [0;m[38;5;43m20221210163511175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163511175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163511175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163511176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163511176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163511176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163511176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:12.863576 run patchelf(pid=24944): Terminating (SIGINT) 16:35:13.031059 run patchelf(pid=24944): Terminated: ok {rc=0} 16:35:13.152212 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24941): Process ended prematurely: osmo-stp_10.42.42.5(pid=24941) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24941)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 16:35:13.161632 tst iperf3.py:8: Test FAILED (7.4 sec) 16:35:13.189528 run osmo-hlr_10.42.42.2(pid=24938): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24938)] 16:35:13.237468 run osmo-hlr_10.42.42.2(pid=24938): stdout: | (launched: 2022-12-10_16:35:10.066390) 16:35:13.286964 run osmo-hlr_10.42.42.2(pid=24938): stderr: | [0;m[1;31m20221210163510244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163510244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163510244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163510244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163510244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163510244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163510257 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163510265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163510265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163510265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:13.337315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24933): Terminating (SIGTERM) 16:35:13.377395 run iperf3-srv_10.42.42.10(pid=24934): Terminating (SIGTERM) 16:35:13.417505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24937): Terminating (SIGTERM) 16:35:13.457640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24940): Terminating (SIGTERM) 16:35:13.497575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24943): Terminating (SIGTERM) 16:35:13.537889 --- ParallelTerminationStrategy: PID 24933 died... 16:35:13.556834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24933): Terminated: ok {rc=0} 16:35:13.601701 --- ParallelTerminationStrategy: PID 24934 died... 16:35:13.620253 run iperf3-srv_10.42.42.10(pid=24934): Terminated {rc=256} 16:35:13.664875 --- ParallelTerminationStrategy: PID 24937 died... 16:35:13.683807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24937): Terminated: ok {rc=0} 16:35:13.728278 --- ParallelTerminationStrategy: PID 24940 died... 16:35:13.746825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24940): Terminated: ok {rc=0} 16:35:13.791758 --- ParallelTerminationStrategy: PID 24943 died... 16:35:13.810445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24943): Terminated: ok {rc=0} 16:35:13.893994 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:35:15.041355 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:15.053680 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:35:15.126722 tst iperf3m4.py: using LAC 29240 16:35:15.244695 tst iperf3m4.py: using RAC 170 16:35:15.359114 tst iperf3m4.py: using CellId 29240 16:35:15.474157 tst iperf3m4.py: using BVCI 29241 16:35:15.584115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:15.595220 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:15.606219 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:15.617748 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:15.629412 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:15.640906 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:15.652575 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:15.664226 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:15.675901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:15.795624 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:15.945359 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:16.062212 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:16.186795 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:35:16.477235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:16.893230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24945): Launched 16:35:17.257793 run iperf3-srv_10.42.42.10(pid=24946): Launched 16:35:17.383398 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:35:17.582959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:17.881923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24947): Launched 16:35:18.140884 run iperf3-srv_10.42.42.10(pid=24948): Launched 16:35:18.252492 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:35:18.450974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:18.749382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24949): Launched 16:35:19.007593 run iperf3-srv_10.42.42.10(pid=24950): Launched 16:35:19.118216 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:35:19.315781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:19.613200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24951): Launched 16:35:19.874469 run iperf3-srv_10.42.42.10(pid=24957): Launched 16:35:19.985278 tst iperf3m4.py:8: start network... 16:35:20.183375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:20.642039 run create_hlr_db(pid=24958): Launched 16:35:20.754315 bus /gobi_6: Setting Powered False 16:35:21.813886 run create_hlr_db(pid=24958): Terminated: ok {rc=0} 16:35:22.247811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24960): Launched 16:35:22.565052 run osmo-hlr_10.42.42.2(pid=24961): Launched 16:35:22.685354 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:23.234383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24963): Launched 16:35:23.550063 run osmo-stp_10.42.42.5(pid=24964): Launched 16:35:23.669578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:24.212804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24966): Launched 16:35:24.333626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:24.600345 run patchelf(pid=24967): Launched 16:35:24.775244 run osmo-stp_10.42.42.5(pid=24964): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24964)] 16:35:24.908761 run osmo-stp_10.42.42.5(pid=24964): stdout: | (launched: 2022-12-10_16:35:23.491938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:25.043505 run osmo-stp_10.42.42.5(pid=24964): stderr: | [0;m[38;5;43m20221210163523681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163523681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163523681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163523682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163523682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163523682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163523682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:25.178441 run osmo-stp_10.42.42.5(pid=24964): stdout: | (launched: 2022-12-10_16:35:23.491938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:25.307210 run osmo-stp_10.42.42.5(pid=24964): stderr: | [0;m[38;5;43m20221210163523681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163523681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163523681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163523682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163523682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163523682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163523682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:25.460505 run patchelf(pid=24967): Terminating (SIGINT) 16:35:25.636917 run patchelf(pid=24967): Terminated: ok {rc=0} 16:35:25.763912 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24964): Process ended prematurely: osmo-stp_10.42.42.5(pid=24964) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24964)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:35:25.774016 tst iperf3m4.py:8: Test FAILED (10.8 sec) 16:35:25.802467 run osmo-hlr_10.42.42.2(pid=24961): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24961)] 16:35:25.851906 run osmo-hlr_10.42.42.2(pid=24961): stdout: | (launched: 2022-12-10_16:35:22.507066) 16:35:25.903063 run osmo-hlr_10.42.42.2(pid=24961): stderr: | [0;m[1;31m20221210163522703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163522703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163522703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163522703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163522703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163522703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163522716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163522724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163522724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163522724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:25.954842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24945): Terminating (SIGTERM) 16:35:25.996695 run iperf3-srv_10.42.42.10(pid=24946): Terminating (SIGTERM) 16:35:26.038146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24947): Terminating (SIGTERM) 16:35:26.079519 run iperf3-srv_10.42.42.10(pid=24948): Terminating (SIGTERM) 16:35:26.120707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24949): Terminating (SIGTERM) 16:35:26.162106 run iperf3-srv_10.42.42.10(pid=24950): Terminating (SIGTERM) 16:35:26.203161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24951): Terminating (SIGTERM) 16:35:26.244544 run iperf3-srv_10.42.42.10(pid=24957): Terminating (SIGTERM) 16:35:26.285991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24960): Terminating (SIGTERM) 16:35:26.327716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24963): Terminating (SIGTERM) 16:35:26.369138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24966): Terminating (SIGTERM) 16:35:26.410702 --- ParallelTerminationStrategy: PID 24945 died... 16:35:26.430516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24945): Terminated: ok {rc=0} 16:35:26.476422 --- ParallelTerminationStrategy: PID 24946 died... 16:35:26.495801 run iperf3-srv_10.42.42.10(pid=24946): Terminated {rc=256} 16:35:26.541489 --- ParallelTerminationStrategy: PID 24947 died... 16:35:26.560749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24947): Terminated: ok {rc=0} 16:35:26.606451 --- ParallelTerminationStrategy: PID 24948 died... 16:35:26.625724 run iperf3-srv_10.42.42.10(pid=24948): Terminated {rc=256} 16:35:26.671344 --- ParallelTerminationStrategy: PID 24949 died... 16:35:26.690771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24949): Terminated: ok {rc=0} 16:35:26.736532 --- ParallelTerminationStrategy: PID 24950 died... 16:35:26.755926 run iperf3-srv_10.42.42.10(pid=24950): Terminated {rc=256} 16:35:26.801872 --- ParallelTerminationStrategy: PID 24951 died... 16:35:26.821504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24951): Terminated: ok {rc=0} 16:35:26.867338 --- ParallelTerminationStrategy: PID 24957 died... 16:35:26.886623 run iperf3-srv_10.42.42.10(pid=24957): Terminated {rc=256} 16:35:26.932328 --- ParallelTerminationStrategy: PID 24960 died... 16:35:26.951790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24960): Terminated: ok {rc=0} 16:35:26.998025 --- ParallelTerminationStrategy: PID 24963 died... 16:35:27.017476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24963): Terminated: ok {rc=0} 16:35:27.063376 --- ParallelTerminationStrategy: PID 24966 died... 16:35:27.082898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24966): Terminated: ok {rc=0} 16:35:27.170298 bus /gobi_4: Setting Powered False 16:35:28.268435 bus /gobi_4: Setting Powered False 16:35:29.386130 bus /gobi_1: Setting Powered False 16:35:30.483595 bus /gobi_1: Setting Powered False 16:35:31.612697 bus /gobi_0: Setting Powered False 16:35:32.721295 bus /gobi_0: Setting Powered False 16:35:33.838573 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:35:34.941280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:34.952938 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:35:35.018829 tst ping.py: using LAC 29241 16:35:35.132454 tst ping.py: using RAC 171 16:35:35.245400 tst ping.py: using CellId 29241 16:35:35.358567 tst ping.py: using BVCI 29242 16:35:35.464757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:35.475949 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:35.486770 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:35.497850 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:35.508799 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:35.519855 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:35.531050 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:35.542151 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:35.659739 tst ping.py:19: start network... 16:35:35.869207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:36.349487 run create_hlr_db(pid=24969): Launched 16:35:36.475773 bus /gobi_6: Setting Powered False 16:35:37.537254 run create_hlr_db(pid=24969): Terminated: ok {rc=0} 16:35:37.954000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24971): Launched 16:35:38.244709 run osmo-hlr_10.42.42.2(pid=24972): Launched 16:35:38.355668 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:38.870068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24974): Launched 16:35:39.160676 run osmo-stp_10.42.42.5(pid=24975): Launched 16:35:39.270532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:39.772529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24977): Launched 16:35:39.884041 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:40.144744 run patchelf(pid=24978): Launched 16:35:40.317158 run osmo-stp_10.42.42.5(pid=24975): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24975)] 16:35:40.449133 run osmo-stp_10.42.42.5(pid=24975): stdout: | (launched: 2022-12-10_16:35:39.106957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:40.582031 run osmo-stp_10.42.42.5(pid=24975): stderr: | [0;m[38;5;43m20221210163539274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163539274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163539274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163539275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163539277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163539277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163539277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:40.714919 run osmo-stp_10.42.42.5(pid=24975): stdout: | (launched: 2022-12-10_16:35:39.106957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:40.842067 run osmo-stp_10.42.42.5(pid=24975): stderr: | [0;m[38;5;43m20221210163539274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163539274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163539274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163539275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163539277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163539277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163539277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:40.992872 run patchelf(pid=24978): Terminating (SIGINT) 16:35:41.166654 run patchelf(pid=24978): Terminated: ok {rc=0} 16:35:41.291608 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24975): Process ended prematurely: osmo-stp_10.42.42.5(pid=24975) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24975)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 16:35:41.301118 tst ping.py:22: Test FAILED (6.4 sec) 16:35:41.329426 run osmo-hlr_10.42.42.2(pid=24972): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24972)] 16:35:41.379424 run osmo-hlr_10.42.42.2(pid=24972): stdout: | (launched: 2022-12-10_16:35:38.190891) 16:35:41.430801 run osmo-hlr_10.42.42.2(pid=24972): stderr: | [0;m[1;31m20221210163538365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163538365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163538366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163538366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163538366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163538366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163538382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163538391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163538391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163538391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:41.482618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24971): Terminating (SIGTERM) 16:35:41.524193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24974): Terminating (SIGTERM) 16:35:41.565947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24977): Terminating (SIGTERM) 16:35:41.607904 --- ParallelTerminationStrategy: PID 24971 died... 16:35:41.627961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24971): Terminated: ok {rc=0} 16:35:41.674614 --- ParallelTerminationStrategy: PID 24974 died... 16:35:41.694329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24974): Terminated: ok {rc=0} 16:35:41.740426 --- ParallelTerminationStrategy: PID 24977 died... 16:35:41.760106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24977): Terminated: ok {rc=0} 16:35:41.847344 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:35:42.934514 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:42.947029 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:35:43.014967 tst ping_idle_ping.py: using LAC 29242 16:35:43.130973 tst ping_idle_ping.py: using RAC 172 16:35:43.246041 tst ping_idle_ping.py: using CellId 29242 16:35:43.360792 tst ping_idle_ping.py: using BVCI 29243 16:35:43.466654 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:43.477954 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:43.489058 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:43.500380 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:43.511723 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:43.523035 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:43.534353 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:43.545548 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:43.660792 tst ping_idle_ping.py:24: start network... 16:35:43.870077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:44.353710 run create_hlr_db(pid=24979): Launched 16:35:44.480237 bus /gobi_6: Setting Powered False 16:35:45.542823 run create_hlr_db(pid=24979): Terminated: ok {rc=0} 16:35:45.986362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24981): Launched 16:35:46.319045 run osmo-hlr_10.42.42.2(pid=24982): Launched 16:35:46.590913 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:47.230931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24984): Launched 16:35:47.552842 run osmo-stp_10.42.42.5(pid=24985): Launched 16:35:47.671388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:48.209496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24987): Launched 16:35:48.328038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:48.591539 run patchelf(pid=24988): Launched 16:35:48.763923 run osmo-stp_10.42.42.5(pid=24985): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24985)] 16:35:48.895697 run osmo-stp_10.42.42.5(pid=24985): stdout: | (launched: 2022-12-10_16:35:47.495732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:49.029594 run osmo-stp_10.42.42.5(pid=24985): stderr: | [0;m[38;5;43m20221210163547688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163547688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163547689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163547689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163547689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163547689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163547690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:49.163110 run osmo-stp_10.42.42.5(pid=24985): stdout: | (launched: 2022-12-10_16:35:47.495732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:49.290575 run osmo-stp_10.42.42.5(pid=24985): stderr: | [0;m[38;5;43m20221210163547688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163547688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163547689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163547689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163547689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163547689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163547690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:49.442222 run patchelf(pid=24988): Terminating (SIGINT) 16:35:49.616290 run patchelf(pid=24988): Terminated: ok {rc=0} 16:35:49.741662 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24985): Process ended prematurely: osmo-stp_10.42.42.5(pid=24985) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24985)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:35:49.751085 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:35:49.778834 run osmo-hlr_10.42.42.2(pid=24982): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24982)] 16:35:49.828740 run osmo-hlr_10.42.42.2(pid=24982): stdout: | (launched: 2022-12-10_16:35:46.260273) 16:35:49.880145 run osmo-hlr_10.42.42.2(pid=24982): stderr: | [0;m[1;31m20221210163546474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163546474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163546474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163546474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163546475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163546475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163546490 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163546500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163546501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163546501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:49.932254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24981): Terminating (SIGTERM) 16:35:49.974027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24984): Terminating (SIGTERM) 16:35:50.015849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24987): Terminating (SIGTERM) 16:35:50.057968 --- ParallelTerminationStrategy: PID 24981 died... 16:35:50.078068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24981): Terminated: ok {rc=0} 16:35:50.124204 --- ParallelTerminationStrategy: PID 24984 died... 16:35:50.143760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24984): Terminated: ok {rc=0} 16:35:50.189544 --- ParallelTerminationStrategy: PID 24987 died... 16:35:50.209164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24987): Terminated: ok {rc=0} 16:35:50.296701 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:35:51.593115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:35:51.599126 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:35:51.630490 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:35:51.669259 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:35:51.756842 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:35:51.787418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:35:51.826130 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:35:52.418183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:35:52.467587 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:35:52.478729 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:35:52.546043 tst cs_paging_gprs_active.py: using LAC 29243 16:35:52.665024 tst cs_paging_gprs_active.py: using RAC 173 16:35:52.790335 tst cs_paging_gprs_active.py: using CellId 29243 16:35:52.916250 tst cs_paging_gprs_active.py: using BVCI 29244 16:35:53.032882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:35:53.045084 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:35:53.056707 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:35:53.068243 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:35:53.079820 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:35:53.091295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:35:53.102904 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:35:53.114901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:35:53.126479 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:35:53.244007 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:35:53.361928 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:35:53.577825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:53.896167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24992): Launched 16:35:54.172115 run iperf3-srv_10.42.42.10(pid=24993): Launched 16:35:54.290401 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:35:54.504903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:54.823131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24994): Launched 16:35:55.099962 run iperf3-srv_10.42.42.10(pid=24995): Launched 16:35:55.219096 tst cs_paging_gprs_active.py:38: start network... 16:35:55.434120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:55.924011 run create_hlr_db(pid=24996): Launched 16:35:56.051520 bus /gobi_6: Setting Powered False 16:35:57.114782 run create_hlr_db(pid=24996): Terminated: ok {rc=0} 16:35:57.555059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24998): Launched 16:35:57.871717 run osmo-hlr_10.42.42.2(pid=24999): Launched 16:35:57.992327 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:58.542086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25001): Launched 16:35:58.857635 run osmo-stp_10.42.42.5(pid=25002): Launched 16:35:58.977742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:59.524841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25004): Launched 16:35:59.645986 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:59.920652 run patchelf(pid=25005): Launched 16:36:00.098897 run osmo-stp_10.42.42.5(pid=25002): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25002)] 16:36:00.233739 run osmo-stp_10.42.42.5(pid=25002): stdout: | (launched: 2022-12-10_16:35:58.799766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:00.370773 run osmo-stp_10.42.42.5(pid=25002): stderr: | [0;m[38;5;43m20221210163558990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163558990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163558991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163558991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163558992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163558992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163558992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:00.507518 run osmo-stp_10.42.42.5(pid=25002): stdout: | (launched: 2022-12-10_16:35:58.799766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:00.637341 run osmo-stp_10.42.42.5(pid=25002): stderr: | [0;m[38;5;43m20221210163558990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163558990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163558991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163558991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163558992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163558992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163558992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:00.791544 run patchelf(pid=25005): Terminating (SIGINT) 16:36:00.973905 run patchelf(pid=25005): Terminated: ok {rc=0} 16:36:01.105177 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25002): Process ended prematurely: osmo-stp_10.42.42.5(pid=25002) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25002)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:36:01.116218 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:36:01.146200 run osmo-hlr_10.42.42.2(pid=24999): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24999)] 16:36:01.197195 run osmo-hlr_10.42.42.2(pid=24999): stdout: | (launched: 2022-12-10_16:35:57.813626) 16:36:01.249865 run osmo-hlr_10.42.42.2(pid=24999): stderr: | [0;m[1;31m20221210163558012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163558012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163558012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163558012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163558012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163558012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163558025 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163558035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163558035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163558035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:01.303163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24992): Terminating (SIGTERM) 16:36:01.346185 run iperf3-srv_10.42.42.10(pid=24993): Terminating (SIGTERM) 16:36:01.391490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24994): Terminating (SIGTERM) 16:36:01.435556 run iperf3-srv_10.42.42.10(pid=24995): Terminating (SIGTERM) 16:36:01.480915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24998): Terminating (SIGTERM) 16:36:01.524658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25001): Terminating (SIGTERM) 16:36:01.570188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25004): Terminating (SIGTERM) 16:36:01.615631 --- ParallelTerminationStrategy: PID 24992 died... 16:36:01.635735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24992): Terminated: ok {rc=0} 16:36:01.685673 --- ParallelTerminationStrategy: PID 24993 died... 16:36:01.705598 run iperf3-srv_10.42.42.10(pid=24993): Terminated {rc=256} 16:36:01.753114 --- ParallelTerminationStrategy: PID 24994 died... 16:36:01.774048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24994): Terminated: ok {rc=0} 16:36:01.821607 --- ParallelTerminationStrategy: PID 24995 died... 16:36:01.841381 run iperf3-srv_10.42.42.10(pid=24995): Terminated {rc=256} 16:36:01.889578 --- ParallelTerminationStrategy: PID 24998 died... 16:36:01.909572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24998): Terminated: ok {rc=0} 16:36:01.957638 --- ParallelTerminationStrategy: PID 25001 died... 16:36:01.978421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25001): Terminated: ok {rc=0} 16:36:02.026093 --- ParallelTerminationStrategy: PID 25004 died... 16:36:02.045874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25004): Terminated: ok {rc=0} 16:36:02.141450 bus /gobi_0: Setting Powered False 16:36:03.255836 bus /gobi_0: Setting Powered False 16:36:04.370360 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:36:05.517240 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:05.529287 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:36:05.597842 tst iperf3.py: using LAC 29244 16:36:05.721310 tst iperf3.py: using RAC 174 16:36:05.844876 tst iperf3.py: using CellId 29244 16:36:05.968443 tst iperf3.py: using BVCI 29245 16:36:06.083017 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:06.094652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:06.106020 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:06.117432 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:06.128625 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:06.139921 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:06.151239 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:06.162460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:06.173911 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:06.291027 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:36:06.504282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:06.820278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25006): Launched 16:36:07.095022 run iperf3-srv_10.42.42.10(pid=25007): Launched 16:36:07.213492 tst iperf3.py:8: start network... 16:36:07.426241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:07.914279 run create_hlr_db(pid=25008): Launched 16:36:08.036447 bus /gobi_6: Setting Powered False 16:36:09.095996 run create_hlr_db(pid=25008): Terminated: ok {rc=0} 16:36:09.530025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25010): Launched 16:36:09.845307 run osmo-hlr_10.42.42.2(pid=25011): Launched 16:36:09.965699 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:10.512813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25013): Launched 16:36:10.829192 run osmo-stp_10.42.42.5(pid=25014): Launched 16:36:10.949769 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:11.495963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25016): Launched 16:36:11.616774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:11.882933 run patchelf(pid=25017): Launched 16:36:12.058082 run osmo-stp_10.42.42.5(pid=25014): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25014)] 16:36:12.192146 run osmo-stp_10.42.42.5(pid=25014): stdout: | (launched: 2022-12-10_16:36:10.771189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:12.328072 run osmo-stp_10.42.42.5(pid=25014): stderr: | [0;m[38;5;43m20221210163610966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163610966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163610966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163610966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163610967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163610967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163610967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:12.464724 run osmo-stp_10.42.42.5(pid=25014): stdout: | (launched: 2022-12-10_16:36:10.771189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:12.594313 run osmo-stp_10.42.42.5(pid=25014): stderr: | [0;m[38;5;43m20221210163610966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163610966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163610966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163610966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163610967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163610967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163610967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:12.747734 run patchelf(pid=25017): Terminating (SIGINT) 16:36:12.924830 run patchelf(pid=25017): Terminated: ok {rc=0} 16:36:13.052319 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25014): Process ended prematurely: osmo-stp_10.42.42.5(pid=25014) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25014)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 16:36:13.062578 tst iperf3.py:8: Test FAILED (7.6 sec) 16:36:13.092321 run osmo-hlr_10.42.42.2(pid=25011): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25011)] 16:36:13.140620 run osmo-hlr_10.42.42.2(pid=25011): stdout: | (launched: 2022-12-10_16:36:09.787573) 16:36:13.190456 run osmo-hlr_10.42.42.2(pid=25011): stderr: | [0;m[1;31m20221210163609988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163609988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163609988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163609988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163609988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163609988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163610001 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163610011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163610011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163610011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:13.240441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25006): Terminating (SIGTERM) 16:36:13.280452 run iperf3-srv_10.42.42.10(pid=25007): Terminating (SIGTERM) 16:36:13.320570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25010): Terminating (SIGTERM) 16:36:13.360687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25013): Terminating (SIGTERM) 16:36:13.400723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25016): Terminating (SIGTERM) 16:36:13.441045 --- ParallelTerminationStrategy: PID 25006 died... 16:36:13.460146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25006): Terminated: ok {rc=0} 16:36:13.504847 --- ParallelTerminationStrategy: PID 25007 died... 16:36:13.523586 run iperf3-srv_10.42.42.10(pid=25007): Terminated {rc=256} 16:36:13.567996 --- ParallelTerminationStrategy: PID 25010 died... 16:36:13.586711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25010): Terminated: ok {rc=0} 16:36:13.631409 --- ParallelTerminationStrategy: PID 25013 died... 16:36:13.650147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25013): Terminated: ok {rc=0} 16:36:13.694667 --- ParallelTerminationStrategy: PID 25016 died... 16:36:13.713502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25016): Terminated: ok {rc=0} 16:36:13.800026 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:36:14.950126 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:14.962510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:36:15.032806 tst iperf3m4.py: using LAC 29245 16:36:15.156292 tst iperf3m4.py: using RAC 175 16:36:15.280504 tst iperf3m4.py: using CellId 29245 16:36:15.404641 tst iperf3m4.py: using BVCI 29246 16:36:15.520388 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:15.532088 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:15.543494 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:15.554824 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:15.566327 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:15.577670 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:15.589370 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:15.600548 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:15.612126 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:15.730099 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:15.844545 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:15.970155 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:16.088331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:36:16.307156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:16.637898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25018): Launched 16:36:16.933757 run iperf3-srv_10.42.42.10(pid=25019): Launched 16:36:17.061136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:36:17.266810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:17.567473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25020): Launched 16:36:17.825599 run iperf3-srv_10.42.42.10(pid=25021): Launched 16:36:17.936890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:36:18.139844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:18.458026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25022): Launched 16:36:18.733719 run iperf3-srv_10.42.42.10(pid=25023): Launched 16:36:18.852005 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:36:19.065014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:19.383749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25024): Launched 16:36:19.658890 run iperf3-srv_10.42.42.10(pid=25025): Launched 16:36:19.778907 tst iperf3m4.py:8: start network... 16:36:19.991748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:20.482337 run create_hlr_db(pid=25026): Launched 16:36:20.610180 bus /gobi_6: Setting Powered False 16:36:21.673243 run create_hlr_db(pid=25026): Terminated: ok {rc=0} 16:36:22.098090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25028): Launched 16:36:22.396380 run osmo-hlr_10.42.42.2(pid=25029): Launched 16:36:22.508776 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:23.024434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25031): Launched 16:36:23.321286 run osmo-stp_10.42.42.5(pid=25032): Launched 16:36:23.434236 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:23.946263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25034): Launched 16:36:24.059829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:24.310532 run patchelf(pid=25035): Launched 16:36:24.475232 run osmo-stp_10.42.42.5(pid=25032): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25032)] 16:36:24.601474 run osmo-stp_10.42.42.5(pid=25032): stdout: | (launched: 2022-12-10_16:36:23.266461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:24.728810 run osmo-stp_10.42.42.5(pid=25032): stderr: | [0;m[38;5;43m20221210163623434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163623434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163623435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163623435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163623436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163623436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163623436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:24.856410 run osmo-stp_10.42.42.5(pid=25032): stdout: | (launched: 2022-12-10_16:36:23.266461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:24.977946 run osmo-stp_10.42.42.5(pid=25032): stderr: | [0;m[38;5;43m20221210163623434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163623434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163623435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163623435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163623436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163623436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163623436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:25.122216 run patchelf(pid=25035): Terminating (SIGINT) 16:36:25.289857 run patchelf(pid=25035): Terminated: ok {rc=0} 16:36:25.410649 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25032): Process ended prematurely: osmo-stp_10.42.42.5(pid=25032) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25032)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:36:25.420120 tst iperf3m4.py:8: Test FAILED (10.5 sec) 16:36:25.447920 run osmo-hlr_10.42.42.2(pid=25029): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25029)] 16:36:25.495243 run osmo-hlr_10.42.42.2(pid=25029): stdout: | (launched: 2022-12-10_16:36:22.341290) 16:36:25.545178 run osmo-hlr_10.42.42.2(pid=25029): stderr: | [0;m[1;31m20221210163622516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163622516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163622516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163622516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163622516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163622516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163622528 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163622537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163622537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163622537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:25.595161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25018): Terminating (SIGTERM) 16:36:25.635294 run iperf3-srv_10.42.42.10(pid=25019): Terminating (SIGTERM) 16:36:25.675087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25020): Terminating (SIGTERM) 16:36:25.714985 run iperf3-srv_10.42.42.10(pid=25021): Terminating (SIGTERM) 16:36:25.754661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25022): Terminating (SIGTERM) 16:36:25.794533 run iperf3-srv_10.42.42.10(pid=25023): Terminating (SIGTERM) 16:36:25.834319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25024): Terminating (SIGTERM) 16:36:25.874172 run iperf3-srv_10.42.42.10(pid=25025): Terminating (SIGTERM) 16:36:25.914021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25028): Terminating (SIGTERM) 16:36:25.953991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25031): Terminating (SIGTERM) 16:36:25.993986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25034): Terminating (SIGTERM) 16:36:26.034117 --- ParallelTerminationStrategy: PID 25018 died... 16:36:26.053287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25018): Terminated: ok {rc=0} 16:36:26.098127 --- ParallelTerminationStrategy: PID 25019 died... 16:36:26.116589 run iperf3-srv_10.42.42.10(pid=25019): Terminated {rc=256} 16:36:26.161236 --- ParallelTerminationStrategy: PID 25020 died... 16:36:26.179708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25020): Terminated: ok {rc=0} 16:36:26.224349 --- ParallelTerminationStrategy: PID 25021 died... 16:36:26.243112 run iperf3-srv_10.42.42.10(pid=25021): Terminated {rc=256} 16:36:26.288294 --- ParallelTerminationStrategy: PID 25022 died... 16:36:26.306902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25022): Terminated: ok {rc=0} 16:36:26.351289 --- ParallelTerminationStrategy: PID 25023 died... 16:36:26.369925 run iperf3-srv_10.42.42.10(pid=25023): Terminated {rc=256} 16:36:26.413949 --- ParallelTerminationStrategy: PID 25024 died... 16:36:26.432865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25024): Terminated: ok {rc=0} 16:36:26.477451 --- ParallelTerminationStrategy: PID 25025 died... 16:36:26.495982 run iperf3-srv_10.42.42.10(pid=25025): Terminated {rc=256} 16:36:26.540365 --- ParallelTerminationStrategy: PID 25028 died... 16:36:26.559051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25028): Terminated: ok {rc=0} 16:36:26.603413 --- ParallelTerminationStrategy: PID 25031 died... 16:36:26.622040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25031): Terminated: ok {rc=0} 16:36:26.666423 --- ParallelTerminationStrategy: PID 25034 died... 16:36:26.685073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25034): Terminated: ok {rc=0} 16:36:26.769466 bus /gobi_4: Setting Powered False 16:36:27.867805 bus /gobi_4: Setting Powered False 16:36:28.986773 bus /gobi_1: Setting Powered False 16:36:30.085217 bus /gobi_1: Setting Powered False 16:36:31.199580 bus /gobi_0: Setting Powered False 16:36:32.299116 bus /gobi_0: Setting Powered False 16:36:33.413950 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:36:34.514127 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:34.525869 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:36:34.593422 tst ping.py: using LAC 29246 16:36:34.717635 tst ping.py: using RAC 176 16:36:34.840035 tst ping.py: using CellId 29246 16:36:34.959181 tst ping.py: using BVCI 29247 16:36:35.064828 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:35.076021 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:35.087044 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:35.098302 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:35.109472 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:35.120545 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:35.131665 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:35.142814 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:35.257239 tst ping.py:19: start network... 16:36:35.452542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:35.902049 run create_hlr_db(pid=25037): Launched 16:36:36.012049 bus /gobi_6: Setting Powered False 16:36:37.071348 run create_hlr_db(pid=25037): Terminated: ok {rc=0} 16:36:37.478036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25039): Launched 16:36:37.769698 run osmo-hlr_10.42.42.2(pid=25040): Launched 16:36:37.880823 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:38.384109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25042): Launched 16:36:38.675360 run osmo-stp_10.42.42.5(pid=25043): Launched 16:36:38.786799 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:39.289584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25045): Launched 16:36:39.402403 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:39.649683 run patchelf(pid=25046): Launched 16:36:39.811885 run osmo-stp_10.42.42.5(pid=25043): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25043)] 16:36:39.935509 run osmo-stp_10.42.42.5(pid=25043): stdout: | (launched: 2022-12-10_16:36:38.621491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:40.060788 run osmo-stp_10.42.42.5(pid=25043): stderr: | [0;m[38;5;43m20221210163638789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163638789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163638790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163638790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163638790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163638791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163638791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:40.186187 run osmo-stp_10.42.42.5(pid=25043): stdout: | (launched: 2022-12-10_16:36:38.621491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:40.305910 run osmo-stp_10.42.42.5(pid=25043): stderr: | [0;m[38;5;43m20221210163638789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163638789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163638790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163638790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163638790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163638791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163638791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:40.448055 run patchelf(pid=25046): Terminating (SIGINT) 16:36:40.611864 run patchelf(pid=25046): Terminated: ok {rc=0} 16:36:40.730023 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25043): Process ended prematurely: osmo-stp_10.42.42.5(pid=25043) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25043)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 16:36:40.738944 tst ping.py:22: Test FAILED (6.2 sec) 16:36:40.766129 run osmo-hlr_10.42.42.2(pid=25040): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25040)] 16:36:40.813828 run osmo-hlr_10.42.42.2(pid=25040): stdout: | (launched: 2022-12-10_16:36:37.714964) 16:36:40.863139 run osmo-hlr_10.42.42.2(pid=25040): stderr: | [0;m[1;31m20221210163637890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163637890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163637890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163637890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163637891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163637891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163637904 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163637914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163637914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163637914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:40.912754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25039): Terminating (SIGTERM) 16:36:40.952515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25042): Terminating (SIGTERM) 16:36:40.992181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25045): Terminating (SIGTERM) 16:36:41.031974 --- ParallelTerminationStrategy: PID 25039 died... 16:36:41.051220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25039): Terminated: ok {rc=0} 16:36:41.095581 --- ParallelTerminationStrategy: PID 25042 died... 16:36:41.114205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25042): Terminated: ok {rc=0} 16:36:41.158334 --- ParallelTerminationStrategy: PID 25045 died... 16:36:41.176735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25045): Terminated: ok {rc=0} 16:36:41.262926 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:36:42.352373 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:42.365303 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:36:42.436263 tst ping_idle_ping.py: using LAC 29247 16:36:42.559358 tst ping_idle_ping.py: using RAC 177 16:36:42.681551 tst ping_idle_ping.py: using CellId 29247 16:36:42.809184 tst ping_idle_ping.py: using BVCI 29248 16:36:42.922982 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:42.934686 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:42.946175 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:42.958133 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:42.970018 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:42.982697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:42.994329 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:43.006197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:43.120617 tst ping_idle_ping.py:24: start network... 16:36:43.316566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:43.770588 run create_hlr_db(pid=25047): Launched 16:36:43.882670 bus /gobi_6: Setting Powered False 16:36:44.941991 run create_hlr_db(pid=25047): Terminated: ok {rc=0} 16:36:45.351599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25049): Launched 16:36:45.644260 run osmo-hlr_10.42.42.2(pid=25050): Launched 16:36:45.755529 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:46.354777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25052): Launched 16:36:46.689661 run osmo-stp_10.42.42.5(pid=25053): Launched 16:36:46.924882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:47.554159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25055): Launched 16:36:47.673803 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:47.937251 run patchelf(pid=25056): Launched 16:36:48.110686 run osmo-stp_10.42.42.5(pid=25053): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25053)] 16:36:48.242894 run osmo-stp_10.42.42.5(pid=25053): stdout: | (launched: 2022-12-10_16:36:46.620566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:48.377372 run osmo-stp_10.42.42.5(pid=25053): stderr: | [0;m[38;5;43m20221210163646907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163646907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163646908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163646908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163646917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163646917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163646917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:48.511609 run osmo-stp_10.42.42.5(pid=25053): stdout: | (launched: 2022-12-10_16:36:46.620566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:48.639880 run osmo-stp_10.42.42.5(pid=25053): stderr: | [0;m[38;5;43m20221210163646907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163646907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163646908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163646908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163646917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163646917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163646917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:48.791155 run patchelf(pid=25056): Terminating (SIGINT) 16:36:48.965215 run patchelf(pid=25056): Terminated: ok {rc=0} 16:36:49.090883 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25053): Process ended prematurely: osmo-stp_10.42.42.5(pid=25053) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25053)] [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:36:49.100319 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:36:49.128305 run osmo-hlr_10.42.42.2(pid=25050): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25050)] 16:36:49.178086 run osmo-hlr_10.42.42.2(pid=25050): stdout: | (launched: 2022-12-10_16:36:45.590117) 16:36:49.229343 run osmo-hlr_10.42.42.2(pid=25050): stderr: | [0;m[1;31m20221210163645762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163645762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163645762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163645762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163645762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163645762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163645775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163645783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163645784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163645784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:49.281420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25049): Terminating (SIGTERM) 16:36:49.323049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25052): Terminating (SIGTERM) 16:36:49.365509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25055): Terminating (SIGTERM) 16:36:49.407502 --- ParallelTerminationStrategy: PID 25049 died... 16:36:49.427608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25049): Terminated: ok {rc=0} 16:36:49.474446 --- ParallelTerminationStrategy: PID 25052 died... 16:36:49.494068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25052): Terminated: ok {rc=0} 16:36:49.540062 --- ParallelTerminationStrategy: PID 25055 died... 16:36:49.559663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25055): Terminated: ok {rc=0} 16:36:49.646127 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:36:50.953503 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:36:50.960795 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:36:50.990561 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:36:51.025733 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:36:51.079105 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:36:51.108529 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:36:51.143723 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:36:51.705989 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:36:51.713163 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:36:51.725847 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:36:51.792815 tst switch_tch_pdch.py: using LAC 29248 16:36:51.909491 tst switch_tch_pdch.py: using RAC 178 16:36:52.023458 tst switch_tch_pdch.py: using CellId 29248 16:36:52.136930 tst switch_tch_pdch.py: using BVCI 29249 16:36:52.242337 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:36:52.253690 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:36:52.264793 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:36:52.276254 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:36:52.287597 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:36:52.299025 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:36:52.310454 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:36:52.322417 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:36:52.435689 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:36:52.552655 tst switch_tch_pdch.py:51: start network... 16:36:52.761576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:53.242236 run create_hlr_db(pid=25061): Launched 16:36:53.369465 bus /gobi_6: Setting Powered False 16:36:54.430852 run create_hlr_db(pid=25061): Terminated: ok {rc=0} 16:36:54.866740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25063): Launched 16:36:55.178171 run osmo-hlr_10.42.42.2(pid=25064): Launched 16:36:55.296107 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:55.831139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25066): Launched 16:36:56.142734 run osmo-stp_10.42.42.5(pid=25067): Launched 16:36:56.260900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:56.798037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25069): Launched 16:36:56.916176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:57.178897 run patchelf(pid=25070): Launched 16:36:57.350980 run osmo-stp_10.42.42.5(pid=25067): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25067)] 16:36:57.483187 run osmo-stp_10.42.42.5(pid=25067): stdout: | (launched: 2022-12-10_16:36:56.084760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:57.617117 run osmo-stp_10.42.42.5(pid=25067): stderr: | [0;m[38;5;43m20221210163656275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163656275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163656276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163656276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163656278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163656278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163656279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:57.750153 run osmo-stp_10.42.42.5(pid=25067): stdout: | (launched: 2022-12-10_16:36:56.084760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:57.877629 run osmo-stp_10.42.42.5(pid=25067): stderr: | [0;m[38;5;43m20221210163656275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163656275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163656276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163656276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163656278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163656278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163656279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:58.028127 run patchelf(pid=25070): Terminating (SIGINT) 16:36:58.202306 run patchelf(pid=25070): Terminated: ok {rc=0} 16:36:58.327589 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25067): Process ended prematurely: osmo-stp_10.42.42.5(pid=25067) [trial-2376↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25067)] [trial-2376↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:36:58.337084 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 16:36:58.365220 run osmo-hlr_10.42.42.2(pid=25064): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25064)] 16:36:58.415096 run osmo-hlr_10.42.42.2(pid=25064): stdout: | (launched: 2022-12-10_16:36:55.120482) 16:36:58.466725 run osmo-hlr_10.42.42.2(pid=25064): stderr: | [0;m[1;31m20221210163655317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163655317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163655317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163655317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163655317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163655317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163655333 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163655342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163655343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163655343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:58.519141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25063): Terminating (SIGTERM) 16:36:58.560850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25066): Terminating (SIGTERM) 16:36:58.602605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25069): Terminating (SIGTERM) 16:36:58.644558 --- ParallelTerminationStrategy: PID 25063 died... 16:36:58.664303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25063): Terminated: ok {rc=0} 16:36:58.710647 --- ParallelTerminationStrategy: PID 25066 died... 16:36:58.730234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25066): Terminated: ok {rc=0} 16:36:58.776024 --- ParallelTerminationStrategy: PID 25069 died... 16:36:58.795491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25069): Terminated: ok {rc=0} 16:36:58.882113 bus /gobi_0: Setting Powered False 16:36:59.979243 bus /gobi_0: Setting Powered False 16:37:01.092338 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:37:02.352498 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:02.358240 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:37:02.387121 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:37:02.421139 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:37:02.475021 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:37:02.504882 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:37:02.538973 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:37:03.097572 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:37:03.102512 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:03.113827 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:37:03.178346 tst switch_tch_pdch.py: using LAC 29249 16:37:03.290378 tst switch_tch_pdch.py: using RAC 179 16:37:03.406839 tst switch_tch_pdch.py: using CellId 29249 16:37:03.520686 tst switch_tch_pdch.py: using BVCI 29250 16:37:03.626762 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:03.637925 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:03.648738 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:03.659868 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:03.670935 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:03.682193 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:03.693429 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:03.704420 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:37:03.821648 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:37:03.936126 tst switch_tch_pdch.py:51: start network... 16:37:04.131211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:04.557194 run create_hlr_db(pid=25075): Launched 16:37:04.667280 bus /gobi_6: Setting Powered False 16:37:05.725489 run create_hlr_db(pid=25075): Terminated: ok {rc=0} 16:37:06.125651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25077): Launched 16:37:06.437182 run osmo-hlr_10.42.42.2(pid=25078): Launched 16:37:06.555405 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:07.063927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25080): Launched 16:37:07.373612 run osmo-stp_10.42.42.5(pid=25081): Launched 16:37:07.492006 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:37:08.004447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25083): Launched 16:37:08.122971 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:37:08.385320 run patchelf(pid=25084): Launched 16:37:08.557260 run osmo-stp_10.42.42.5(pid=25081): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25081)] 16:37:08.688910 run osmo-stp_10.42.42.5(pid=25081): stdout: | (launched: 2022-12-10_16:37:07.316549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:08.821950 run osmo-stp_10.42.42.5(pid=25081): stderr: | [0;m[38;5;43m20221210163707505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163707505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163707506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163707506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163707508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163707508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163707508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:08.954974 run osmo-stp_10.42.42.5(pid=25081): stdout: | (launched: 2022-12-10_16:37:07.316549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:09.081990 run osmo-stp_10.42.42.5(pid=25081): stderr: | [0;m[38;5;43m20221210163707505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163707505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163707506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163707506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163707508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163707508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163707508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:09.232694 run patchelf(pid=25084): Terminating (SIGINT) 16:37:09.407516 run patchelf(pid=25084): Terminated: ok {rc=0} 16:37:09.533145 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25081): Process ended prematurely: osmo-stp_10.42.42.5(pid=25081) [trial-2376↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25081)] [trial-2376↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:37:09.542503 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 16:37:09.570332 run osmo-hlr_10.42.42.2(pid=25078): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25078)] 16:37:09.620240 run osmo-hlr_10.42.42.2(pid=25078): stdout: | (launched: 2022-12-10_16:37:06.379805) 16:37:09.672239 run osmo-hlr_10.42.42.2(pid=25078): stderr: | [0;m[1;31m20221210163706579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163706579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163706579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163706579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163706579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163706579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163706592 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163706600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163706601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163706601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:09.723912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25077): Terminating (SIGTERM) 16:37:09.765301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25080): Terminating (SIGTERM) 16:37:09.807142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25083): Terminating (SIGTERM) 16:37:09.848788 --- ParallelTerminationStrategy: PID 25077 died... 16:37:09.868677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25077): Terminated: ok {rc=0} 16:37:09.914829 --- ParallelTerminationStrategy: PID 25080 died... 16:37:09.934258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25080): Terminated: ok {rc=0} 16:37:09.979950 --- ParallelTerminationStrategy: PID 25083 died... 16:37:09.999337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25083): Terminated: ok {rc=0} 16:37:10.086429 bus /gobi_0: Setting Powered False 16:37:11.184204 bus /gobi_0: Setting Powered False 16:37:12.299215 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_sms:nanobts --------------------------------------------------------------------- 16:37:13.545657 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:13.549257 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 16:37:13.573553 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 16:37:13.580525 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 16:37:13.631933 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 16:37:13.655357 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 16:37:13.662286 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 16:37:14.199789 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 16:37:14.204645 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 16:37:14.215357 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 16:37:14.252864 tst mo_mt_sms.py: using LAC 29250 16:37:14.366697 tst mo_mt_sms.py: using RAC 180 16:37:14.482494 tst mo_mt_sms.py: using CellId 29250 16:37:14.597709 tst mo_mt_sms.py: using BVCI 29251 16:37:14.710839 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 16:37:14.824621 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 16:37:14.940361 tst mo_mt_sms.py:9: start nitb and bts... 16:37:15.149011 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:37:15.785856 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25089): Launched 16:37:16.145751 run osmo-nitb_10.42.42.2(pid=25090): Launched 16:37:16.333360 run osmo-nitb_10.42.42.2(pid=25090): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25090)] 16:37:16.478406 run osmo-nitb_10.42.42.2(pid=25090): stdout: | (launched: 2022-12-10_16:37:16.074952) 16:37:16.622071 run osmo-nitb_10.42.42.2(pid=25090): stderr: | (launched: 2022-12-10_16:37:16.122434) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:37:16.765828 run osmo-nitb_10.42.42.2(pid=25090): stdout: | (launched: 2022-12-10_16:37:16.074952) 16:37:16.903970 run osmo-nitb_10.42.42.2(pid=25090): stderr: | (launched: 2022-12-10_16:37:16.122434) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25090): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25090) [trial-2376↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25090)] 16:37:17.277196 tst osmo-nitb_10.42.42.2(pid=25090): stdout: | (launched: 2022-12-10_16:37:16.074952) 16:37:17.395375 tst osmo-nitb_10.42.42.2(pid=25090): stderr: | (launched: 2022-12-10_16:37:16.122434) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:37:17.535361 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25090): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25090) [trial-2376↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25090)] [trial-2376↪nitb_sms:nanobts↪mo_mt_sms.py:11] 16:37:17.543925 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:37:17.550609 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25089): Terminating (SIGTERM) 16:37:17.760118 --- ParallelTerminationStrategy: PID 25089 died... 16:37:17.780737 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25089): Terminated: ok {rc=0} 16:37:17.865866 bus /sierra_3: Setting Powered False 16:37:18.965207 bus /sierra_3: Setting Powered False 16:37:20.082677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 sms:nanobts+band-1900 --------------------------------------------------------------------- 16:37:21.266232 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:21.271090 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:37:21.295042 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 16:37:21.321427 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 16:37:21.374047 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:37:21.397895 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 16:37:21.423888 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 16:37:21.968762 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 16:37:21.973709 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:21.984252 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:37:22.021616 tst mo_mt_sms.py: using LAC 29251 16:37:22.144208 tst mo_mt_sms.py: using RAC 181 16:37:22.265392 tst mo_mt_sms.py: using CellId 29251 16:37:22.387406 tst mo_mt_sms.py: using BVCI 29252 16:37:22.494771 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:22.505562 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:22.516108 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:22.527053 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:22.538023 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:22.548746 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 16:37:22.664551 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 16:37:22.776497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:23.228338 run create_hlr_db(pid=25096): Launched 16:37:23.339257 bus /sierra_2: Setting Powered False 16:37:24.398195 run create_hlr_db(pid=25096): Terminated: ok {rc=0} 16:37:24.823405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25098): Launched 16:37:25.134922 run osmo-hlr_10.42.42.2(pid=25099): Launched 16:37:25.253451 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:25.788489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25101): Launched 16:37:26.098454 run osmo-stp_10.42.42.5(pid=25102): Launched 16:37:26.216045 run osmo-msc_10.42.42.6: Starting osmo-msc 16:37:26.778395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25104): Launched 16:37:27.088636 run osmo-msc_10.42.42.6(pid=25105): Launched 16:37:27.261838 run osmo-stp_10.42.42.5(pid=25102): ERR: Terminated: ERROR {rc=1} [trial-2376↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25102)] 16:37:27.393517 run osmo-stp_10.42.42.5(pid=25102): stdout: | (launched: 2022-12-10_16:37:26.041312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:27.526553 run osmo-stp_10.42.42.5(pid=25102): stderr: | [0;m[38;5;43m20221210163726232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163726232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163726232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163726233 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163726233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163726233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163726233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:27.657652 run osmo-stp_10.42.42.5(pid=25102): stdout: | (launched: 2022-12-10_16:37:26.041312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:27.782346 run osmo-stp_10.42.42.5(pid=25102): stderr: | [0;m[38;5;43m20221210163726232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163726232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163726232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163726233 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163726233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163726233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163726233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:27.931305 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25102): Process ended prematurely: osmo-stp_10.42.42.5(pid=25102) [trial-2376↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25102)] [trial-2376↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 16:37:27.939895 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 16:37:27.967059 run osmo-hlr_10.42.42.2(pid=25099): ERR: Terminated: ERROR {rc=237} [trial-2376↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25099)] 16:37:28.016696 run osmo-hlr_10.42.42.2(pid=25099): stdout: | (launched: 2022-12-10_16:37:25.077664) 16:37:28.068149 run osmo-hlr_10.42.42.2(pid=25099): stderr: | [0;m[1;31m20221210163725275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163725275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163725275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163725275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163725275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163725276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163725288 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163725296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163725296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163725296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:28.139722 run osmo-msc_10.42.42.6(pid=25105): ERR: Terminated: ERROR {rc=2} [trial-2376↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25105)] 16:37:28.189415 run osmo-msc_10.42.42.6(pid=25105): stdout: | (launched: 2022-12-10_16:37:27.031381) 16:37:28.240554 run osmo-msc_10.42.42.6(pid=25105): stderr: | [0;m[38;5;43m20221210163727352 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163727352 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc01a21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163727352 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163727352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163727353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163727353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163727355 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163727355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163727355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163727355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:37:28.292329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25098): Terminating (SIGTERM) 16:37:28.333937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25101): Terminating (SIGTERM) 16:37:28.375405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25104): Terminating (SIGTERM) 16:37:28.417929 --- ParallelTerminationStrategy: PID 25098 died... 16:37:28.437875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25098): Terminated: ok {rc=0} 16:37:28.483827 --- ParallelTerminationStrategy: PID 25101 died... 16:37:28.503321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25101): Terminated: ok {rc=0} 16:37:28.549242 --- ParallelTerminationStrategy: PID 25104 died... 16:37:28.568585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25104): Terminated: ok {rc=0} 16:37:28.655884 bus /sierra_3: Setting Powered False 16:37:29.752397 bus /sierra_3: Setting Powered False 16:37:30.878867 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 16:37:32.142197 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:32.147629 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:37:32.181846 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 16:37:32.191847 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 16:37:32.233983 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:37:32.259520 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 16:37:32.267107 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 16:37:32.779116 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2376 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 16:37:32.785518 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 16:37:32.796780 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:37:32.837243 tst assert_extension.py: using LAC 29252 16:37:32.960366 tst assert_extension.py: using RAC 182 16:37:33.083785 tst assert_extension.py: using CellId 29252 16:37:33.204474 tst assert_extension.py: using BVCI 29253 16:37:33.310819 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 16:37:33.421839 tst assert_extension.py:10: start nitb and bts... 16:37:33.616692 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:37:34.212625 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25110): Launched 16:37:34.503322 run osmo-nitb_10.42.42.2(pid=25111): Launched 16:37:34.663628 run osmo-nitb_10.42.42.2(pid=25111): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25111)] 16:37:34.794127 run osmo-nitb_10.42.42.2(pid=25111): stdout: | (launched: 2022-12-10_16:37:34.449693) 16:37:34.925954 run osmo-nitb_10.42.42.2(pid=25111): stderr: | (launched: 2022-12-10_16:37:34.492753) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:37:35.057871 run osmo-nitb_10.42.42.2(pid=25111): stdout: | (launched: 2022-12-10_16:37:34.449693) 16:37:35.184343 run osmo-nitb_10.42.42.2(pid=25111): stderr: | (launched: 2022-12-10_16:37:34.492753) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25111): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25111) [trial-2376↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25111)] 16:37:35.612398 tst osmo-nitb_10.42.42.2(pid=25111): stdout: | (launched: 2022-12-10_16:37:34.449693) 16:37:35.730257 tst osmo-nitb_10.42.42.2(pid=25111): stderr: | (launched: 2022-12-10_16:37:34.492753) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:37:35.869438 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25111): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25111) [trial-2376↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25111)] [trial-2376↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 16:37:35.877645 tst assert_extension.py:12: Test FAILED (3.1 sec) 16:37:35.884298 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25110): Terminating (SIGTERM) 16:37:36.093721 --- ParallelTerminationStrategy: PID 25110 died... 16:37:36.115061 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25110): Terminated: ok {rc=0} 16:37:36.202272 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 ussd:nanobts+band-1900 --------------------------------------------------------------------- 16:37:37.367389 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:37.372172 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:37:37.396027 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 16:37:37.423227 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 16:37:37.461469 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:37:37.485175 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 16:37:37.511817 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 16:37:38.037011 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 16:37:38.042246 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:38.052770 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:37:38.090464 tst assert_extension.py: using LAC 29253 16:37:38.205050 tst assert_extension.py: using RAC 183 16:37:38.317688 tst assert_extension.py: using CellId 29253 16:37:38.430238 tst assert_extension.py: using BVCI 29254 16:37:38.535237 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:38.545913 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:38.556524 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:38.567522 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:38.578401 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:38.589425 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 16:37:38.704219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:39.154629 run create_hlr_db(pid=25115): Launched 16:37:39.264821 bus /sierra_2: Setting Powered False 16:37:40.323929 run create_hlr_db(pid=25115): Terminated: ok {rc=0} 16:37:40.754723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25117): Launched 16:37:41.066341 run osmo-hlr_10.42.42.2(pid=25118): Launched 16:37:41.184886 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:41.728830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25120): Launched 16:37:42.040544 run osmo-stp_10.42.42.5(pid=25121): Launched 16:37:42.158905 run osmo-msc_10.42.42.6: Starting osmo-msc 16:37:42.721523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25123): Launched 16:37:43.032750 run osmo-msc_10.42.42.6(pid=25124): Launched 16:37:43.205498 run osmo-stp_10.42.42.5(pid=25121): ERR: Terminated: ERROR {rc=1} [trial-2376↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25121)] 16:37:43.336873 run osmo-stp_10.42.42.5(pid=25121): stdout: | (launched: 2022-12-10_16:37:41.983262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:43.468679 run osmo-stp_10.42.42.5(pid=25121): stderr: | [0;m[38;5;43m20221210163742176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163742176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163742177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163742177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163742177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163742178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163742178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:43.599318 run osmo-stp_10.42.42.5(pid=25121): stdout: | (launched: 2022-12-10_16:37:41.983262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:43.723471 run osmo-stp_10.42.42.5(pid=25121): stderr: | [0;m[38;5;43m20221210163742176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163742176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163742177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163742177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163742177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163742178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163742178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:43.871531 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25121): Process ended prematurely: osmo-stp_10.42.42.5(pid=25121) [trial-2376↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25121)] [trial-2376↪ussd:nanobts+band-1900↪assert_extension.py:17] 16:37:43.880253 tst assert_extension.py:17: Test FAILED (5.8 sec) 16:37:43.907941 run osmo-hlr_10.42.42.2(pid=25118): ERR: Terminated: ERROR {rc=237} [trial-2376↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25118)] 16:37:43.958270 run osmo-hlr_10.42.42.2(pid=25118): stdout: | (launched: 2022-12-10_16:37:41.009241) 16:37:44.010518 run osmo-hlr_10.42.42.2(pid=25118): stderr: | [0;m[1;31m20221210163741206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163741206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163741206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163741206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163741206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163741206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163741219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163741229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163741229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163741229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:44.083053 run osmo-msc_10.42.42.6(pid=25124): ERR: Terminated: ERROR {rc=2} [trial-2376↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25124)] 16:37:44.133382 run osmo-msc_10.42.42.6(pid=25124): stdout: | (launched: 2022-12-10_16:37:42.975514) 16:37:44.185077 run osmo-msc_10.42.42.6(pid=25124): stderr: | [0;m[38;5;43m20221210163743297 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163743297 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0dafe7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163743297 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163743297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163743298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163743298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163743301 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163743302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163743302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163743302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:37:44.237340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25117): Terminating (SIGTERM) 16:37:44.279229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25120): Terminating (SIGTERM) 16:37:44.321054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25123): Terminating (SIGTERM) 16:37:44.363139 --- ParallelTerminationStrategy: PID 25117 died... 16:37:44.383171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25117): Terminated: ok {rc=0} 16:37:44.430105 --- ParallelTerminationStrategy: PID 25120 died... 16:37:44.449898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25120): Terminated: ok {rc=0} 16:37:44.496171 --- ParallelTerminationStrategy: PID 25123 died... 16:37:44.515774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25123): Terminated: ok {rc=0} 16:37:44.603134 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:37:45.798019 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:45.805392 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:37:45.829996 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:37:45.875992 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:37:45.967534 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:37:45.993049 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:37:46.022029 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:37:46.582369 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:37:46.635636 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:46.648271 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:37:46.711049 tst mo_mt_call.py: using LAC 29254 16:37:46.834957 tst mo_mt_call.py: using RAC 184 16:37:46.957793 tst mo_mt_call.py: using CellId 29254 16:37:47.076897 tst mo_mt_call.py: using BVCI 29255 16:37:47.206351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:47.218793 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:47.231561 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:47.243679 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:47.255696 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:47.267939 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:37:47.381627 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:37:47.501504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:47.992323 run create_hlr_db(pid=25129): Launched 16:37:48.120874 bus /sierra_2: Setting Powered False 16:37:49.184684 run create_hlr_db(pid=25129): Terminated: ok {rc=0} 16:37:49.610272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25131): Launched 16:37:49.907243 run osmo-hlr_10.42.42.2(pid=25132): Launched 16:37:50.020324 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:50.546019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25134): Launched 16:37:50.841389 run osmo-stp_10.42.42.5(pid=25135): Launched 16:37:50.953687 run osmo-msc_10.42.42.6: Starting osmo-msc 16:37:51.491686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25137): Launched 16:37:51.788226 run osmo-msc_10.42.42.6(pid=25138): Launched 16:37:51.955142 run osmo-stp_10.42.42.5(pid=25135): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25135)] 16:37:52.081609 run osmo-stp_10.42.42.5(pid=25135): stdout: | (launched: 2022-12-10_16:37:50.787108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:52.208101 run osmo-stp_10.42.42.5(pid=25135): stderr: | [0;m[38;5;43m20221210163750954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163750954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163750954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163750955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163750957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163750957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163750957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:52.331869 run osmo-stp_10.42.42.5(pid=25135): stdout: | (launched: 2022-12-10_16:37:50.787108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:52.450788 run osmo-stp_10.42.42.5(pid=25135): stderr: | [0;m[38;5;43m20221210163750954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163750954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163750954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163750955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163750957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163750957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163750957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:52.592383 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25135): Process ended prematurely: osmo-stp_10.42.42.5(pid=25135) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25135)] [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:37:52.601200 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:37:52.628033 run osmo-hlr_10.42.42.2(pid=25132): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25132)] 16:37:52.675817 run osmo-hlr_10.42.42.2(pid=25132): stdout: | (launched: 2022-12-10_16:37:49.852587) 16:37:52.725346 run osmo-hlr_10.42.42.2(pid=25132): stderr: | [0;m[1;31m20221210163750029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163750030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163750030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163750030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163750030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163750030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163750047 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163750056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163750057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163750057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:52.794446 run osmo-msc_10.42.42.6(pid=25138): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25138)] 16:37:52.842247 run osmo-msc_10.42.42.6(pid=25138): stdout: | (launched: 2022-12-10_16:37:51.733412) 16:37:52.891273 run osmo-msc_10.42.42.6(pid=25138): stderr: | [0;m[38;5;43m20221210163752005 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163752005 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b13630c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163752005 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163752005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163752006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163752006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163752007 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163752008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163752008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163752008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:37:52.940708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25131): Terminating (SIGTERM) 16:37:52.980293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25134): Terminating (SIGTERM) 16:37:53.019641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25137): Terminating (SIGTERM) 16:37:53.059802 --- ParallelTerminationStrategy: PID 25131 died... 16:37:53.078858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25131): Terminated: ok {rc=0} 16:37:53.123302 --- ParallelTerminationStrategy: PID 25134 died... 16:37:53.141844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25134): Terminated: ok {rc=0} 16:37:53.185973 --- ParallelTerminationStrategy: PID 25137 died... 16:37:53.204476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25137): Terminated: ok {rc=0} 16:37:53.288640 bus /sierra_3: Setting Powered False 16:37:54.387422 bus /sierra_3: Setting Powered False 16:37:55.502225 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:37:56.651291 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:56.663611 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:37:56.725737 tst mo_mt_call_osmux.py: using LAC 29255 16:37:56.844164 tst mo_mt_call_osmux.py: using RAC 185 16:37:56.960856 tst mo_mt_call_osmux.py: using CellId 29255 16:37:57.077330 tst mo_mt_call_osmux.py: using BVCI 29256 16:37:57.185843 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:57.197220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:57.208290 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:57.219538 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:57.230972 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:37:57.242212 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:37:57.355753 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:37:57.472670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:57.963598 run create_hlr_db(pid=25140): Launched 16:37:58.091895 bus /sierra_2: Setting Powered False 16:37:59.155652 run create_hlr_db(pid=25140): Terminated: ok {rc=0} 16:37:59.579697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25142): Launched 16:37:59.877486 run osmo-hlr_10.42.42.2(pid=25143): Launched 16:37:59.990521 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:00.513340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25145): Launched 16:38:00.811415 run osmo-stp_10.42.42.5(pid=25146): Launched 16:38:01.075737 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:01.628066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25148): Launched 16:38:01.985721 run osmo-msc_10.42.42.6(pid=25149): Launched 16:38:02.320297 run osmo-stp_10.42.42.5(pid=25146): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25146)] 16:38:02.456627 run osmo-stp_10.42.42.5(pid=25146): stdout: | (launched: 2022-12-10_16:38:00.756209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:02.593722 run osmo-stp_10.42.42.5(pid=25146): stderr: | [0;m[38;5;43m20221210163800942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163800942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163800942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163800943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163800943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163800943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163800943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:02.727452 run osmo-stp_10.42.42.5(pid=25146): stdout: | (launched: 2022-12-10_16:38:00.756209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:02.853938 run osmo-stp_10.42.42.5(pid=25146): stderr: | [0;m[38;5;43m20221210163800942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163800942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163800942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163800943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163800943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163800943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163800943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:03.005480 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25146): Process ended prematurely: osmo-stp_10.42.42.5(pid=25146) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25146)] [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:38:03.015218 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:38:03.043160 run osmo-hlr_10.42.42.2(pid=25143): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25143)] 16:38:03.093303 run osmo-hlr_10.42.42.2(pid=25143): stdout: | (launched: 2022-12-10_16:37:59.822932) 16:38:03.145203 run osmo-hlr_10.42.42.2(pid=25143): stderr: | [0;m[1;31m20221210163800000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163800000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163800000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163800000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163800000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163800000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163800013 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163800021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163800021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163800022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:03.217497 run osmo-msc_10.42.42.6(pid=25149): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25149)] 16:38:03.267467 run osmo-msc_10.42.42.6(pid=25149): stdout: | (launched: 2022-12-10_16:38:01.915981) 16:38:03.319201 run osmo-msc_10.42.42.6(pid=25149): stderr: | [0;m[38;5;43m20221210163802384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163802384 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f272843ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163802384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163802384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163802384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163802384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163802386 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163802387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163802387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163802387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:03.371398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25142): Terminating (SIGTERM) 16:38:03.413537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25145): Terminating (SIGTERM) 16:38:03.455320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25148): Terminating (SIGTERM) 16:38:03.497288 --- ParallelTerminationStrategy: PID 25142 died... 16:38:03.517375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25142): Terminated: ok {rc=0} 16:38:03.564311 --- ParallelTerminationStrategy: PID 25145 died... 16:38:03.584025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25145): Terminated: ok {rc=0} 16:38:03.630142 --- ParallelTerminationStrategy: PID 25148 died... 16:38:03.649679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25148): Terminated: ok {rc=0} 16:38:03.737245 bus /sierra_3: Setting Powered False 16:38:04.834285 bus /sierra_3: Setting Powered False 16:38:05.950646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:38:07.191549 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:38:07.198732 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:38:07.222494 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:38:07.249110 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:38:07.297882 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:38:07.321180 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:38:07.347321 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:38:07.901798 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:38:07.949394 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:07.960646 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:38:08.017539 tst mo_mt_call.py: using LAC 29256 16:38:08.134564 tst mo_mt_call.py: using RAC 186 16:38:08.249031 tst mo_mt_call.py: using CellId 29256 16:38:08.363274 tst mo_mt_call.py: using BVCI 29257 16:38:08.470465 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:08.481612 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:08.492523 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:08.503721 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:08.515016 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:08.526214 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:38:08.643611 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:38:08.759724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:09.219136 run create_hlr_db(pid=25154): Launched 16:38:09.331212 bus /sierra_2: Setting Powered False 16:38:10.390384 run create_hlr_db(pid=25154): Terminated: ok {rc=0} 16:38:10.804528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25156): Launched 16:38:11.101124 run osmo-hlr_10.42.42.2(pid=25157): Launched 16:38:11.214399 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:11.722690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25159): Launched 16:38:12.020004 run osmo-stp_10.42.42.5(pid=25160): Launched 16:38:12.132912 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:12.669081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25162): Launched 16:38:12.965960 run osmo-msc_10.42.42.6(pid=25163): Launched 16:38:13.131619 run osmo-stp_10.42.42.5(pid=25160): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25160)] 16:38:13.257485 run osmo-stp_10.42.42.5(pid=25160): stdout: | (launched: 2022-12-10_16:38:11.965135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:13.383725 run osmo-stp_10.42.42.5(pid=25160): stderr: | [0;m[38;5;43m20221210163812133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163812133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163812133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163812134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163812136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163812136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163812136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:13.507386 run osmo-stp_10.42.42.5(pid=25160): stdout: | (launched: 2022-12-10_16:38:11.965135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:13.625746 run osmo-stp_10.42.42.5(pid=25160): stderr: | [0;m[38;5;43m20221210163812133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163812133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163812133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163812134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163812136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163812136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163812136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:13.767064 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25160): Process ended prematurely: osmo-stp_10.42.42.5(pid=25160) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25160)] [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:38:13.776201 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 16:38:13.802881 run osmo-hlr_10.42.42.2(pid=25157): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25157)] 16:38:13.850570 run osmo-hlr_10.42.42.2(pid=25157): stdout: | (launched: 2022-12-10_16:38:11.046425) 16:38:13.899796 run osmo-hlr_10.42.42.2(pid=25157): stderr: | [0;m[1;31m20221210163811222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163811222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163811222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163811222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163811222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163811222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163811234 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163811247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163811247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163811247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:13.968348 run osmo-msc_10.42.42.6(pid=25163): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25163)] 16:38:14.015795 run osmo-msc_10.42.42.6(pid=25163): stdout: | (launched: 2022-12-10_16:38:12.911020) 16:38:14.064731 run osmo-msc_10.42.42.6(pid=25163): stderr: | [0;m[38;5;43m20221210163813184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163813184 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4bdaac3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163813184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163813184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163813184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163813184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163813186 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163813186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163813187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163813187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:14.114000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25156): Terminating (SIGTERM) 16:38:14.153685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25159): Terminating (SIGTERM) 16:38:14.193197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25162): Terminating (SIGTERM) 16:38:14.233575 --- ParallelTerminationStrategy: PID 25156 died... 16:38:14.252653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25156): Terminated: ok {rc=0} 16:38:14.297061 --- ParallelTerminationStrategy: PID 25159 died... 16:38:14.315493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25159): Terminated: ok {rc=0} 16:38:14.359410 --- ParallelTerminationStrategy: PID 25162 died... 16:38:14.377848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25162): Terminated: ok {rc=0} 16:38:14.461460 bus /sierra_3: Setting Powered False 16:38:15.558441 bus /sierra_3: Setting Powered False 16:38:16.694441 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:38:17.890494 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:17.906999 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:38:17.980915 tst mo_mt_call_osmux.py: using LAC 29257 16:38:18.134895 tst mo_mt_call_osmux.py: using RAC 187 16:38:18.277111 tst mo_mt_call_osmux.py: using CellId 29257 16:38:18.427397 tst mo_mt_call_osmux.py: using BVCI 29258 16:38:18.564270 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:18.580106 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:18.601734 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:18.614673 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:18.631875 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:18.644839 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:38:18.802273 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:38:18.957232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:19.462124 run create_hlr_db(pid=25436): Launched 16:38:19.625150 bus /sierra_2: Setting Powered False 16:38:20.686849 run create_hlr_db(pid=25436): Terminated: ok {rc=0} 16:38:21.125720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25440): Launched 16:38:21.466445 run osmo-hlr_10.42.42.2(pid=25441): Launched 16:38:21.709417 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:22.381633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25443): Launched 16:38:22.722609 run osmo-stp_10.42.42.5(pid=25444): Launched 16:38:22.967089 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:23.647589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25446): Launched 16:38:23.998810 run osmo-msc_10.42.42.6(pid=25447): Launched 16:38:24.366201 run osmo-stp_10.42.42.5(pid=25444): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25444)] 16:38:24.644502 run osmo-stp_10.42.42.5(pid=25444): stdout: | (launched: 2022-12-10_16:38:22.662841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:24.818163 run osmo-stp_10.42.42.5(pid=25444): stderr: | [0;m[38;5;43m20221210163822949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163822949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163822950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163822950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163822950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163822951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163822951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:24.955781 run osmo-stp_10.42.42.5(pid=25444): stdout: | (launched: 2022-12-10_16:38:22.662841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:25.088862 run osmo-stp_10.42.42.5(pid=25444): stderr: | [0;m[38;5;43m20221210163822949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163822949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163822950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163822950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163822950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163822951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163822951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:25.249485 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25444): Process ended prematurely: osmo-stp_10.42.42.5(pid=25444) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25444)] [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:38:25.260114 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 16:38:25.290457 run osmo-hlr_10.42.42.2(pid=25441): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25441)] 16:38:25.342995 run osmo-hlr_10.42.42.2(pid=25441): stdout: | (launched: 2022-12-10_16:38:21.400792) 16:38:25.398983 run osmo-hlr_10.42.42.2(pid=25441): stderr: | [0;m[1;31m20221210163821712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163821712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163821712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163821712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163821712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163821712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163821731 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163821747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163821748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163821748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:25.475958 run osmo-msc_10.42.42.6(pid=25447): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25447)] 16:38:25.528133 run osmo-msc_10.42.42.6(pid=25447): stdout: | (launched: 2022-12-10_16:38:23.933582) 16:38:25.583418 run osmo-msc_10.42.42.6(pid=25447): stderr: | [0;m[38;5;43m20221210163824435 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163824435 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f018a179c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163824435 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163824435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163824435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163824436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163824446 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163824446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163824446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163824446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:25.637581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25440): Terminating (SIGTERM) 16:38:25.682079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25443): Terminating (SIGTERM) 16:38:25.727790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25446): Terminating (SIGTERM) 16:38:25.774589 --- ParallelTerminationStrategy: PID 25440 died... 16:38:25.795592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25440): Terminated: ok {rc=0} 16:38:25.845174 --- ParallelTerminationStrategy: PID 25443 died... 16:38:25.866502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25443): Terminated: ok {rc=0} 16:38:25.914172 --- ParallelTerminationStrategy: PID 25446 died... 16:38:25.935137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25446): Terminated: ok {rc=0} 16:38:26.027691 bus /sierra_3: Setting Powered False 16:38:27.131343 bus /sierra_3: Setting Powered False 16:38:28.250942 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:38:29.500180 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:38:29.508511 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:38:29.534796 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:38:29.563703 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:38:29.617823 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:38:29.643610 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:38:29.672221 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:38:30.225771 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:38:30.281426 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:30.294467 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:38:30.356553 tst mo_mt_call.py: using LAC 29258 16:38:30.485945 tst mo_mt_call.py: using RAC 188 16:38:30.616562 tst mo_mt_call.py: using CellId 29258 16:38:30.744796 tst mo_mt_call.py: using BVCI 29259 16:38:30.889096 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:30.903939 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:30.922201 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:30.941222 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:30.956067 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:30.975575 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:38:31.135155 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:38:31.270147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:31.839908 run create_hlr_db(pid=25452): Launched 16:38:31.960058 bus /sierra_2: Setting Powered False 16:38:33.030026 run create_hlr_db(pid=25452): Terminated: ok {rc=0} 16:38:33.491346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25454): Launched 16:38:33.817470 run osmo-hlr_10.42.42.2(pid=25455): Launched 16:38:34.047119 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:34.779037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25457): Launched 16:38:35.106303 run osmo-stp_10.42.42.5(pid=25458): Launched 16:38:35.341234 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:36.077817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25460): Launched 16:38:36.408694 run osmo-msc_10.42.42.6(pid=25461): Launched 16:38:36.755786 run osmo-stp_10.42.42.5(pid=25458): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25458)] 16:38:37.024001 run osmo-stp_10.42.42.5(pid=25458): stdout: | (launched: 2022-12-10_16:38:35.043862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:37.299449 run osmo-stp_10.42.42.5(pid=25458): stderr: | [0;m[38;5;43m20221210163835382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163835382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163835382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163835383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163835383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163835383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163835383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:37.474851 run osmo-stp_10.42.42.5(pid=25458): stdout: | (launched: 2022-12-10_16:38:35.043862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:37.600355 run osmo-stp_10.42.42.5(pid=25458): stderr: | [0;m[38;5;43m20221210163835382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163835382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163835382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163835383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163835383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163835383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163835383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:37.750598 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25458): Process ended prematurely: osmo-stp_10.42.42.5(pid=25458) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25458)] [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:38:37.760480 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 16:38:37.791062 run osmo-hlr_10.42.42.2(pid=25455): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25455)] 16:38:37.841629 run osmo-hlr_10.42.42.2(pid=25455): stdout: | (launched: 2022-12-10_16:38:33.756628) 16:38:37.894191 run osmo-hlr_10.42.42.2(pid=25455): stderr: | [0;m[1;31m20221210163834106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163834106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163834106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163834106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163834106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163834106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163834122 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163834139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163834139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163834139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:37.966626 run osmo-msc_10.42.42.6(pid=25461): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25461)] 16:38:38.017662 run osmo-msc_10.42.42.6(pid=25461): stdout: | (launched: 2022-12-10_16:38:36.343911) 16:38:38.069511 run osmo-msc_10.42.42.6(pid=25461): stderr: | [0;m[38;5;43m20221210163836946 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163836946 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f83bf0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163836946 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163836946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163836946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163836946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163836948 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163836949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163836949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163836949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:38.122037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25454): Terminating (SIGTERM) 16:38:38.164769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25457): Terminating (SIGTERM) 16:38:38.209297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25460): Terminating (SIGTERM) 16:38:38.255340 --- ParallelTerminationStrategy: PID 25454 died... 16:38:38.275790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25454): Terminated: ok {rc=0} 16:38:38.325668 --- ParallelTerminationStrategy: PID 25457 died... 16:38:38.345658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25457): Terminated: ok {rc=0} 16:38:38.393821 --- ParallelTerminationStrategy: PID 25460 died... 16:38:38.413888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25460): Terminated: ok {rc=0} 16:38:38.502702 bus /sierra_3: Setting Powered False 16:38:39.601354 bus /sierra_3: Setting Powered False 16:38:40.715615 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:38:41.860903 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:41.873249 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:38:41.935817 tst mo_mt_call_osmux.py: using LAC 29259 16:38:42.061466 tst mo_mt_call_osmux.py: using RAC 189 16:38:42.184707 tst mo_mt_call_osmux.py: using CellId 29259 16:38:42.311637 tst mo_mt_call_osmux.py: using BVCI 29260 16:38:42.430409 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:42.442217 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:42.453870 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:42.465874 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:42.477680 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:42.489255 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:38:42.607275 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:38:42.723391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:43.188611 run create_hlr_db(pid=25464): Launched 16:38:43.303185 bus /sierra_2: Setting Powered False 16:38:44.364520 run create_hlr_db(pid=25464): Terminated: ok {rc=0} 16:38:44.784026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25466): Launched 16:38:45.083634 run osmo-hlr_10.42.42.2(pid=25467): Launched 16:38:45.198031 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:45.716899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25469): Launched 16:38:46.057724 run osmo-stp_10.42.42.5(pid=25470): Launched 16:38:46.284418 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:47.006889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25472): Launched 16:38:47.368801 run osmo-msc_10.42.42.6(pid=25473): Launched 16:38:47.540345 run osmo-stp_10.42.42.5(pid=25470): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25470)] 16:38:47.669511 run osmo-stp_10.42.42.5(pid=25470): stdout: | (launched: 2022-12-10_16:38:45.987793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:47.803571 run osmo-stp_10.42.42.5(pid=25470): stderr: | [0;m[38;5;43m20221210163846294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163846294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163846295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163846295 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163846297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163846297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163846298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:47.937210 run osmo-stp_10.42.42.5(pid=25470): stdout: | (launched: 2022-12-10_16:38:45.987793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:48.065103 run osmo-stp_10.42.42.5(pid=25470): stderr: | [0;m[38;5;43m20221210163846294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163846294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163846295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163846295 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163846297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163846297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163846298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:48.218294 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25470): Process ended prematurely: osmo-stp_10.42.42.5(pid=25470) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25470)] [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:38:48.227800 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:38:48.255653 run osmo-hlr_10.42.42.2(pid=25467): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25467)] 16:38:48.305800 run osmo-hlr_10.42.42.2(pid=25467): stdout: | (launched: 2022-12-10_16:38:45.028320) 16:38:48.357528 run osmo-hlr_10.42.42.2(pid=25467): stderr: | [0;m[1;31m20221210163845202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163845202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163845202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163845202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163845202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163845202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163845214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163845223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163845223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163845223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:48.430007 run osmo-msc_10.42.42.6(pid=25473): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25473)] 16:38:48.479982 run osmo-msc_10.42.42.6(pid=25473): stdout: | (launched: 2022-12-10_16:38:47.311628) 16:38:48.531438 run osmo-msc_10.42.42.6(pid=25473): stderr: | [0;m[38;5;43m20221210163847584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163847584 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c6db81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163847584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163847584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163847584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163847585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163847586 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163847587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163847587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163847587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:48.583287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25466): Terminating (SIGTERM) 16:38:48.624757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25469): Terminating (SIGTERM) 16:38:48.666330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25472): Terminating (SIGTERM) 16:38:48.708014 --- ParallelTerminationStrategy: PID 25466 died... 16:38:48.728057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25466): Terminated: ok {rc=0} 16:38:48.774190 --- ParallelTerminationStrategy: PID 25469 died... 16:38:48.793644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25469): Terminated: ok {rc=0} 16:38:48.839691 --- ParallelTerminationStrategy: PID 25472 died... 16:38:48.859149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25472): Terminated: ok {rc=0} 16:38:48.946610 bus /sierra_3: Setting Powered False 16:38:50.043534 bus /sierra_3: Setting Powered False 16:38:51.158534 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:38:52.399462 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:38:52.407631 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:38:52.432586 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:38:52.460173 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:38:52.512464 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:38:52.536577 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:38:52.563573 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:38:53.117781 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:38:53.168683 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:38:53.180421 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:38:53.241383 tst mo_mt_call.py: using LAC 29260 16:38:53.367534 tst mo_mt_call.py: using RAC 190 16:38:53.488008 tst mo_mt_call.py: using CellId 29260 16:38:53.605376 tst mo_mt_call.py: using BVCI 29261 16:38:53.713918 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:38:53.725333 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:38:53.736789 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:38:53.748445 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:38:53.760117 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:38:53.771718 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:38:53.890808 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:38:54.006611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:54.471271 run create_hlr_db(pid=25478): Launched 16:38:54.589820 bus /sierra_2: Setting Powered False 16:38:55.650114 run create_hlr_db(pid=25478): Terminated: ok {rc=0} 16:38:56.087783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25480): Launched 16:38:56.407262 run osmo-hlr_10.42.42.2(pid=25481): Launched 16:38:56.530538 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:57.080281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25483): Launched 16:38:57.400558 run osmo-stp_10.42.42.5(pid=25484): Launched 16:38:57.522933 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:58.100852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25486): Launched 16:38:58.419781 run osmo-msc_10.42.42.6(pid=25487): Launched 16:38:58.599608 run osmo-stp_10.42.42.5(pid=25484): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25484)] 16:38:58.734237 run osmo-stp_10.42.42.5(pid=25484): stdout: | (launched: 2022-12-10_16:38:57.341889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:58.869125 run osmo-stp_10.42.42.5(pid=25484): stderr: | [0;m[38;5;43m20221210163857532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163857533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163857533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163857533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163857536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163857536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163857536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:59.003393 run osmo-stp_10.42.42.5(pid=25484): stdout: | (launched: 2022-12-10_16:38:57.341889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:59.130429 run osmo-stp_10.42.42.5(pid=25484): stderr: | [0;m[38;5;43m20221210163857532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163857533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163857533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163857533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163857536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163857536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163857536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:59.282666 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25484): Process ended prematurely: osmo-stp_10.42.42.5(pid=25484) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25484)] [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:38:59.291963 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:38:59.319723 run osmo-hlr_10.42.42.2(pid=25481): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25481)] 16:38:59.369353 run osmo-hlr_10.42.42.2(pid=25481): stdout: | (launched: 2022-12-10_16:38:56.348830) 16:38:59.420812 run osmo-hlr_10.42.42.2(pid=25481): stderr: | [0;m[1;31m20221210163856545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163856545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163856545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163856545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163856545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163856545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163856557 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163856565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163856565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163856565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:59.493138 run osmo-msc_10.42.42.6(pid=25487): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25487)] 16:38:59.542835 run osmo-msc_10.42.42.6(pid=25487): stdout: | (launched: 2022-12-10_16:38:58.361682) 16:38:59.594631 run osmo-msc_10.42.42.6(pid=25487): stderr: | [0;m[38;5;43m20221210163858683 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163858684 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc6e2a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163858684 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163858684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163858684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163858684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163858686 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163858686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163858686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163858686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:59.646101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25480): Terminating (SIGTERM) 16:38:59.687482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25483): Terminating (SIGTERM) 16:38:59.729045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25486): Terminating (SIGTERM) 16:38:59.770925 --- ParallelTerminationStrategy: PID 25480 died... 16:38:59.790554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25480): Terminated: ok {rc=0} 16:38:59.836501 --- ParallelTerminationStrategy: PID 25483 died... 16:38:59.855945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25483): Terminated: ok {rc=0} 16:38:59.901764 --- ParallelTerminationStrategy: PID 25486 died... 16:38:59.921168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25486): Terminated: ok {rc=0} 16:39:00.007785 bus /sierra_3: Setting Powered False 16:39:01.114952 bus /sierra_3: Setting Powered False 16:39:02.251114 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:39:03.399534 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:03.411686 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:39:03.473383 tst mo_mt_call_osmux.py: using LAC 29261 16:39:03.599374 tst mo_mt_call_osmux.py: using RAC 191 16:39:03.716905 tst mo_mt_call_osmux.py: using CellId 29261 16:39:03.837344 tst mo_mt_call_osmux.py: using BVCI 29262 16:39:03.947249 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:03.958650 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:03.970068 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:03.981670 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:03.993445 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:04.005372 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:39:04.120807 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:39:04.243260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:04.741835 run create_hlr_db(pid=25489): Launched 16:39:04.874623 bus /sierra_2: Setting Powered False 16:39:05.937255 run create_hlr_db(pid=25489): Terminated: ok {rc=0} 16:39:06.377695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25491): Launched 16:39:06.695318 run osmo-hlr_10.42.42.2(pid=25492): Launched 16:39:06.814613 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:07.361997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25494): Launched 16:39:07.678102 run osmo-stp_10.42.42.5(pid=25495): Launched 16:39:07.797922 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:08.370216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25497): Launched 16:39:08.688017 run osmo-msc_10.42.42.6(pid=25498): Launched 16:39:08.864118 run osmo-stp_10.42.42.5(pid=25495): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25495)] 16:39:08.997303 run osmo-stp_10.42.42.5(pid=25495): stdout: | (launched: 2022-12-10_16:39:07.620423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:09.131304 run osmo-stp_10.42.42.5(pid=25495): stderr: | [0;m[38;5;43m20221210163907813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163907813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163907813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163907813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163907814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163907814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163907814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:09.264301 run osmo-stp_10.42.42.5(pid=25495): stdout: | (launched: 2022-12-10_16:39:07.620423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:09.390596 run osmo-stp_10.42.42.5(pid=25495): stderr: | [0;m[38;5;43m20221210163907813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163907813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163907813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163907813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163907814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163907814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163907814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:09.542074 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25495): Process ended prematurely: osmo-stp_10.42.42.5(pid=25495) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25495)] [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:39:09.551589 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:39:09.579643 run osmo-hlr_10.42.42.2(pid=25492): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25492)] 16:39:09.629745 run osmo-hlr_10.42.42.2(pid=25492): stdout: | (launched: 2022-12-10_16:39:06.637469) 16:39:09.681391 run osmo-hlr_10.42.42.2(pid=25492): stderr: | [0;m[1;31m20221210163906836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163906836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163906836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163906836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163906836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163906836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163906850 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163906858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163906859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163906859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:09.753635 run osmo-msc_10.42.42.6(pid=25498): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25498)] 16:39:09.803668 run osmo-msc_10.42.42.6(pid=25498): stdout: | (launched: 2022-12-10_16:39:08.630141) 16:39:09.855236 run osmo-msc_10.42.42.6(pid=25498): stderr: | [0;m[38;5;43m20221210163908950 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163908950 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f78d475cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163908950 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163908950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163908950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163908951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163908952 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163908953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163908953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163908953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:09.906970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25491): Terminating (SIGTERM) 16:39:09.948750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25494): Terminating (SIGTERM) 16:39:09.990592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25497): Terminating (SIGTERM) 16:39:10.032558 --- ParallelTerminationStrategy: PID 25491 died... 16:39:10.052227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25491): Terminated: ok {rc=0} 16:39:10.098653 --- ParallelTerminationStrategy: PID 25494 died... 16:39:10.118132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25494): Terminated: ok {rc=0} 16:39:10.164133 --- ParallelTerminationStrategy: PID 25497 died... 16:39:10.183605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25497): Terminated: ok {rc=0} 16:39:10.270178 bus /sierra_3: Setting Powered False 16:39:11.368537 bus /sierra_3: Setting Powered False 16:39:12.481104 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:39:13.722926 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:13.731250 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:39:13.756100 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:39:13.783399 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:39:13.837843 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:39:13.862923 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:39:13.890262 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:39:14.442480 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:39:14.493134 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:14.504757 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:39:14.565742 tst mo_mt_call.py: using LAC 29262 16:39:14.694573 tst mo_mt_call.py: using RAC 192 16:39:14.821166 tst mo_mt_call.py: using CellId 29262 16:39:14.944815 tst mo_mt_call.py: using BVCI 29263 16:39:15.059219 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:15.070944 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:15.082530 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:15.094061 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:15.105663 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:15.117094 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:39:15.230818 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:39:15.348748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:15.847593 run create_hlr_db(pid=25503): Launched 16:39:15.989901 bus /sierra_2: Setting Powered False 16:39:17.061090 run create_hlr_db(pid=25503): Terminated: ok {rc=0} 16:39:17.496066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25505): Launched 16:39:17.813385 run osmo-hlr_10.42.42.2(pid=25506): Launched 16:39:17.933369 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:18.478575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25508): Launched 16:39:18.796045 run osmo-stp_10.42.42.5(pid=25509): Launched 16:39:18.916559 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:19.494590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25511): Launched 16:39:19.811040 run osmo-msc_10.42.42.6(pid=25512): Launched 16:39:19.987160 run osmo-stp_10.42.42.5(pid=25509): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25509)] 16:39:20.120053 run osmo-stp_10.42.42.5(pid=25509): stdout: | (launched: 2022-12-10_16:39:18.738042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:20.254354 run osmo-stp_10.42.42.5(pid=25509): stderr: | [0;m[38;5;43m20221210163918930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163918930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163918931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163918931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163918931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163918931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163918931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:20.387240 run osmo-stp_10.42.42.5(pid=25509): stdout: | (launched: 2022-12-10_16:39:18.738042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:20.514254 run osmo-stp_10.42.42.5(pid=25509): stderr: | [0;m[38;5;43m20221210163918930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163918930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163918931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163918931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163918931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163918931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163918931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:20.665644 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25509): Process ended prematurely: osmo-stp_10.42.42.5(pid=25509) [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25509)] [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:39:20.675280 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:39:20.703166 run osmo-hlr_10.42.42.2(pid=25506): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25506)] 16:39:20.753152 run osmo-hlr_10.42.42.2(pid=25506): stdout: | (launched: 2022-12-10_16:39:17.755064) 16:39:20.804645 run osmo-hlr_10.42.42.2(pid=25506): stderr: | [0;m[1;31m20221210163917950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163917951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163917951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163917951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163917951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163917951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163917963 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163917971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163917972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163917972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:20.876680 run osmo-msc_10.42.42.6(pid=25512): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25512)] 16:39:20.926502 run osmo-msc_10.42.42.6(pid=25512): stdout: | (launched: 2022-12-10_16:39:19.753067) 16:39:20.977553 run osmo-msc_10.42.42.6(pid=25512): stderr: | [0;m[38;5;43m20221210163920073 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163920073 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2306c1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163920073 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163920073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163920074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163920074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163920075 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163920076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163920076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163920076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:21.029150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25505): Terminating (SIGTERM) 16:39:21.070408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25508): Terminating (SIGTERM) 16:39:21.111675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25511): Terminating (SIGTERM) 16:39:21.153349 --- ParallelTerminationStrategy: PID 25505 died... 16:39:21.172866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25505): Terminated: ok {rc=0} 16:39:21.218952 --- ParallelTerminationStrategy: PID 25508 died... 16:39:21.238398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25508): Terminated: ok {rc=0} 16:39:21.284202 --- ParallelTerminationStrategy: PID 25511 died... 16:39:21.303696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25511): Terminated: ok {rc=0} 16:39:21.390849 bus /sierra_3: Setting Powered False 16:39:22.489255 bus /sierra_3: Setting Powered False 16:39:23.603615 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:39:24.751953 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:24.764264 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:39:24.826535 tst mo_mt_call_osmux.py: using LAC 29263 16:39:24.949597 tst mo_mt_call_osmux.py: using RAC 193 16:39:25.074396 tst mo_mt_call_osmux.py: using CellId 29263 16:39:25.199296 tst mo_mt_call_osmux.py: using BVCI 29264 16:39:25.313871 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:25.325632 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:25.337159 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:25.348693 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:25.360397 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:25.371959 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:39:25.487106 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:39:25.601466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:26.060847 run create_hlr_db(pid=25514): Launched 16:39:26.174167 bus /sierra_2: Setting Powered False 16:39:27.233525 run create_hlr_db(pid=25514): Terminated: ok {rc=0} 16:39:27.668449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25516): Launched 16:39:27.984510 run osmo-hlr_10.42.42.2(pid=25517): Launched 16:39:28.106278 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:28.651761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25519): Launched 16:39:28.968061 run osmo-stp_10.42.42.5(pid=25520): Launched 16:39:29.088212 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:29.662972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25522): Launched 16:39:29.978848 run osmo-msc_10.42.42.6(pid=25523): Launched 16:39:30.154595 run osmo-stp_10.42.42.5(pid=25520): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25520)] 16:39:30.287620 run osmo-stp_10.42.42.5(pid=25520): stdout: | (launched: 2022-12-10_16:39:28.910415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:30.421560 run osmo-stp_10.42.42.5(pid=25520): stderr: | [0;m[38;5;43m20221210163929102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163929102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163929102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163929103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163929103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163929103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163929103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:30.555730 run osmo-stp_10.42.42.5(pid=25520): stdout: | (launched: 2022-12-10_16:39:28.910415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:30.682409 run osmo-stp_10.42.42.5(pid=25520): stderr: | [0;m[38;5;43m20221210163929102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163929102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163929102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163929103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163929103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163929103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163929103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:30.845934 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25520): Process ended prematurely: osmo-stp_10.42.42.5(pid=25520) [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25520)] [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:39:30.857846 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:39:30.910245 run osmo-hlr_10.42.42.2(pid=25517): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25517)] 16:39:30.969178 run osmo-hlr_10.42.42.2(pid=25517): stdout: | (launched: 2022-12-10_16:39:27.926777) 16:39:31.027475 run osmo-hlr_10.42.42.2(pid=25517): stderr: | [0;m[1;31m20221210163928127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163928127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163928127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163928127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163928128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163928128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163928140 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163928150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163928150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163928150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:31.115079 run osmo-msc_10.42.42.6(pid=25523): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25523)] 16:39:31.177194 run osmo-msc_10.42.42.6(pid=25523): stdout: | (launched: 2022-12-10_16:39:29.921202) 16:39:31.241149 run osmo-msc_10.42.42.6(pid=25523): stderr: | [0;m[38;5;43m20221210163930242 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163930242 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff2f6898c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163930242 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163930242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163930242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163930242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163930244 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163930245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163930245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163930245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:31.306866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25516): Terminating (SIGTERM) 16:39:31.359542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25519): Terminating (SIGTERM) 16:39:31.414305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25522): Terminating (SIGTERM) 16:39:31.465311 --- ParallelTerminationStrategy: PID 25516 died... 16:39:31.489339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25516): Terminated: ok {rc=0} 16:39:31.546897 --- ParallelTerminationStrategy: PID 25519 died... 16:39:31.570425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25519): Terminated: ok {rc=0} 16:39:31.624576 --- ParallelTerminationStrategy: PID 25522 died... 16:39:31.649348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25522): Terminated: ok {rc=0} 16:39:31.755425 bus /sierra_3: Setting Powered False 16:39:32.863332 bus /sierra_3: Setting Powered False 16:39:33.975694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 emergency:nanobts+band-1900 --------------------------------------------------------------------- 16:39:35.211082 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:35.216201 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:39:35.239904 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 16:39:35.267172 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 16:39:35.349988 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:39:35.373656 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 16:39:35.400244 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 16:39:35.989420 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2376 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 16:39:35.995888 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:36.007100 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:39:36.055537 tst emergency_mo_mt_call.py: using LAC 29264 16:39:36.188142 tst emergency_mo_mt_call.py: using RAC 194 16:39:36.311195 tst emergency_mo_mt_call.py: using CellId 29264 16:39:36.435607 tst emergency_mo_mt_call.py: using BVCI 29265 16:39:36.548017 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:36.559269 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:36.570466 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:36.581575 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:36.592574 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:36.603563 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:39:36.717259 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:39:36.833190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:37.313820 run create_hlr_db(pid=25528): Launched 16:39:37.439653 bus /sierra_2: Setting Powered False 16:39:38.501614 run create_hlr_db(pid=25528): Terminated: ok {rc=0} 16:39:38.918732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25530): Launched 16:39:39.210239 run osmo-hlr_10.42.42.2(pid=25531): Launched 16:39:39.320912 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:39.821044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25533): Launched 16:39:40.111855 run osmo-stp_10.42.42.5(pid=25534): Launched 16:39:40.230690 tst emergency_mo_mt_call.py: using MSISDN 7796 16:39:40.394196 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:40.917911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25536): Launched 16:39:41.208547 run osmo-msc_10.42.42.6(pid=25537): Launched 16:39:41.370501 run osmo-stp_10.42.42.5(pid=25534): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25534)] 16:39:41.501229 run osmo-stp_10.42.42.5(pid=25534): stdout: | (launched: 2022-12-10_16:39:40.058396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:41.635390 run osmo-stp_10.42.42.5(pid=25534): stderr: | [0;m[38;5;43m20221210163940229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163940230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163940230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163940230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163940231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163940231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163940231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:41.765753 run osmo-stp_10.42.42.5(pid=25534): stdout: | (launched: 2022-12-10_16:39:40.058396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:41.890052 run osmo-stp_10.42.42.5(pid=25534): stderr: | [0;m[38;5;43m20221210163940229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163940230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163940230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163940230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163940231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163940231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163940231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:42.038293 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25534): Process ended prematurely: osmo-stp_10.42.42.5(pid=25534) [trial-2376↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25534)] [trial-2376↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 16:39:42.047155 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 16:39:42.074535 run osmo-hlr_10.42.42.2(pid=25531): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25531)] 16:39:42.124481 run osmo-hlr_10.42.42.2(pid=25531): stdout: | (launched: 2022-12-10_16:39:39.156313) 16:39:42.176200 run osmo-hlr_10.42.42.2(pid=25531): stderr: | [0;m[1;31m20221210163939330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163939330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163939330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163939330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163939330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163939331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163939356 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163939366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163939366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163939366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:42.248365 run osmo-msc_10.42.42.6(pid=25537): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25537)] 16:39:42.298413 run osmo-msc_10.42.42.6(pid=25537): stdout: | (launched: 2022-12-10_16:39:41.154701) 16:39:42.349963 run osmo-msc_10.42.42.6(pid=25537): stderr: | [0;m[38;5;43m20221210163941425 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163941425 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc8c6ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163941425 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163941426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163941426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163941426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163941428 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163941428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163941428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163941428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:42.401471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25530): Terminating (SIGTERM) 16:39:42.443391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25533): Terminating (SIGTERM) 16:39:42.485422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25536): Terminating (SIGTERM) 16:39:42.527758 --- ParallelTerminationStrategy: PID 25530 died... 16:39:42.547949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25530): Terminated: ok {rc=0} 16:39:42.594665 --- ParallelTerminationStrategy: PID 25533 died... 16:39:42.614309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25533): Terminated: ok {rc=0} 16:39:42.660431 --- ParallelTerminationStrategy: PID 25536 died... 16:39:42.680078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25536): Terminated: ok {rc=0} 16:39:42.766828 bus /sierra_3: Setting Powered False 16:39:43.864093 bus /sierra_3: Setting Powered False 16:39:44.979470 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 16:39:46.065593 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:46.078067 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:39:46.122316 tst emergency_preemptive_call.py: using LAC 29265 16:39:46.256613 tst emergency_preemptive_call.py: using RAC 195 16:39:46.383672 tst emergency_preemptive_call.py: using CellId 29265 16:39:46.507050 tst emergency_preemptive_call.py: using BVCI 29266 16:39:46.616546 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:46.628511 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:46.640246 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:46.652709 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:46.666434 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:46.679299 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:39:46.799029 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:39:46.940100 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:39:47.060375 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:39:47.201538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:47.689301 run create_hlr_db(pid=25539): Launched 16:39:47.815764 bus /sierra_2: Setting Powered False 16:39:48.877789 run create_hlr_db(pid=25539): Terminated: ok {rc=0} 16:39:49.295765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25541): Launched 16:39:49.586745 run osmo-hlr_10.42.42.2(pid=25542): Launched 16:39:49.698219 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:50.213130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25544): Launched 16:39:50.503827 run osmo-stp_10.42.42.5(pid=25545): Launched 16:39:50.623437 tst emergency_preemptive_call.py: using MSISDN 7797 16:39:50.785770 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:51.307418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25547): Launched 16:39:51.599007 run osmo-msc_10.42.42.6(pid=25548): Launched 16:39:51.760896 run osmo-stp_10.42.42.5(pid=25545): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25545)] 16:39:51.885098 run osmo-stp_10.42.42.5(pid=25545): stdout: | (launched: 2022-12-10_16:39:50.450438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:52.009986 run osmo-stp_10.42.42.5(pid=25545): stderr: | [0;m[38;5;43m20221210163950620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163950620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163950620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163950621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163950621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163950621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163950621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:52.132053 run osmo-stp_10.42.42.5(pid=25545): stdout: | (launched: 2022-12-10_16:39:50.450438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:52.248690 run osmo-stp_10.42.42.5(pid=25545): stderr: | [0;m[38;5;43m20221210163950620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210163950620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210163950620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210163950621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210163950621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210163950621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210163950621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:52.388002 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25545): Process ended prematurely: osmo-stp_10.42.42.5(pid=25545) [trial-2376↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25545)] [trial-2376↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 16:39:52.396274 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 16:39:52.423206 run osmo-hlr_10.42.42.2(pid=25542): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25542)] 16:39:52.470859 run osmo-hlr_10.42.42.2(pid=25542): stdout: | (launched: 2022-12-10_16:39:49.533337) 16:39:52.520081 run osmo-hlr_10.42.42.2(pid=25542): stderr: | [0;m[1;31m20221210163949708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210163949708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210163949708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210163949708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210163949708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210163949708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210163949721 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210163949729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210163949729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210163949730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:52.589092 run osmo-msc_10.42.42.6(pid=25548): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25548)] 16:39:52.636566 run osmo-msc_10.42.42.6(pid=25548): stdout: | (launched: 2022-12-10_16:39:51.544340) 16:39:52.686005 run osmo-msc_10.42.42.6(pid=25548): stderr: | [0;m[38;5;43m20221210163951815 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210163951815 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4502686c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210163951815 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210163951815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210163951815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210163951815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210163951817 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210163951818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210163951818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210163951818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:52.735943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25541): Terminating (SIGTERM) 16:39:52.775545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25544): Terminating (SIGTERM) 16:39:52.815575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25547): Terminating (SIGTERM) 16:39:52.855776 --- ParallelTerminationStrategy: PID 25541 died... 16:39:52.874850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25541): Terminated: ok {rc=0} 16:39:52.919528 --- ParallelTerminationStrategy: PID 25544 died... 16:39:52.938321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25544): Terminated: ok {rc=0} 16:39:52.982721 --- ParallelTerminationStrategy: PID 25547 died... 16:39:53.001372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25547): Terminated: ok {rc=0} 16:39:53.086946 bus /sierra_9: Setting Powered False 16:39:54.184812 bus /sierra_9: Setting Powered False 16:39:55.300033 bus /sierra_8: Setting Powered False 16:39:56.398108 bus /sierra_8: Setting Powered False 16:39:57.511996 bus /sierra_3: Setting Powered False 16:39:58.610681 bus /sierra_3: Setting Powered False 16:39:59.726150 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-1900 --------------------------------------------------------------------- 16:40:01.027133 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:40:01.032940 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:40:01.057564 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 16:40:01.097540 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 16:40:01.186255 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:40:01.217407 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 16:40:01.268564 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 16:40:01.870111 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 16:40:01.932424 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:01.948592 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:40:01.990592 tst cs_paging_gprs_active.py: using LAC 29266 16:40:02.142374 tst cs_paging_gprs_active.py: using RAC 196 16:40:02.279119 tst cs_paging_gprs_active.py: using CellId 29266 16:40:02.405462 tst cs_paging_gprs_active.py: using BVCI 29267 16:40:02.520590 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:02.531756 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:02.542724 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:02.553662 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:02.564558 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:02.575468 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:02.586725 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:02.597612 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:02.608617 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:02.728539 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:02.848494 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:40:03.066201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:03.385199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25556): Launched 16:40:03.661372 run iperf3-srv_10.42.42.10(pid=25557): Launched 16:40:03.779719 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:40:03.994209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:04.312677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25558): Launched 16:40:04.589067 run iperf3-srv_10.42.42.10(pid=25559): Launched 16:40:04.707222 tst cs_paging_gprs_active.py:38: start network... 16:40:04.921806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:05.413713 run create_hlr_db(pid=25560): Launched 16:40:05.542163 bus /sierra_2: Setting Powered False 16:40:06.605716 run create_hlr_db(pid=25560): Terminated: ok {rc=0} 16:40:07.030522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25562): Launched 16:40:07.327308 run osmo-hlr_10.42.42.2(pid=25563): Launched 16:40:07.440296 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:07.963102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25565): Launched 16:40:08.260026 run osmo-stp_10.42.42.5(pid=25566): Launched 16:40:08.372870 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:08.885833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25568): Launched 16:40:08.999367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:09.251040 run patchelf(pid=25569): Launched 16:40:09.416760 run osmo-stp_10.42.42.5(pid=25566): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25566)] 16:40:09.543077 run osmo-stp_10.42.42.5(pid=25566): stdout: | (launched: 2022-12-10_16:40:08.205630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:09.671353 run osmo-stp_10.42.42.5(pid=25566): stderr: | [0;m[38;5;43m20221210164008373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164008373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164008374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164008374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164008375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164008375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164008375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:09.799907 run osmo-stp_10.42.42.5(pid=25566): stdout: | (launched: 2022-12-10_16:40:08.205630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:09.922112 run osmo-stp_10.42.42.5(pid=25566): stderr: | [0;m[38;5;43m20221210164008373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164008373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164008374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164008374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164008375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164008375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164008375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:10.066860 run patchelf(pid=25569): Terminating (SIGINT) 16:40:10.234866 run patchelf(pid=25569): Terminated: ok {rc=0} 16:40:10.356092 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25566): Process ended prematurely: osmo-stp_10.42.42.5(pid=25566) [trial-2376↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25566)] [trial-2376↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 16:40:10.365489 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:40:10.392817 run osmo-hlr_10.42.42.2(pid=25563): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25563)] 16:40:10.440288 run osmo-hlr_10.42.42.2(pid=25563): stdout: | (launched: 2022-12-10_16:40:07.272654) 16:40:10.489462 run osmo-hlr_10.42.42.2(pid=25563): stderr: | [0;m[1;31m20221210164007446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164007446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164007446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164007446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164007446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164007446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164007458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164007466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164007467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164007467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:10.539253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25556): Terminating (SIGTERM) 16:40:10.579176 run iperf3-srv_10.42.42.10(pid=25557): Terminating (SIGTERM) 16:40:10.618838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25558): Terminating (SIGTERM) 16:40:10.658575 run iperf3-srv_10.42.42.10(pid=25559): Terminating (SIGTERM) 16:40:10.698241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25562): Terminating (SIGTERM) 16:40:10.737803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25565): Terminating (SIGTERM) 16:40:10.777333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25568): Terminating (SIGTERM) 16:40:10.817926 --- ParallelTerminationStrategy: PID 25556 died... 16:40:10.837086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25556): Terminated: ok {rc=0} 16:40:10.881464 --- ParallelTerminationStrategy: PID 25557 died... 16:40:10.899744 run iperf3-srv_10.42.42.10(pid=25557): Terminated {rc=256} 16:40:10.943859 --- ParallelTerminationStrategy: PID 25558 died... 16:40:10.962386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25558): Terminated: ok {rc=0} 16:40:11.007025 --- ParallelTerminationStrategy: PID 25559 died... 16:40:11.025526 run iperf3-srv_10.42.42.10(pid=25559): Terminated {rc=256} 16:40:11.069799 --- ParallelTerminationStrategy: PID 25562 died... 16:40:11.088219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25562): Terminated: ok {rc=0} 16:40:11.132500 --- ParallelTerminationStrategy: PID 25565 died... 16:40:11.151046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25565): Terminated: ok {rc=0} 16:40:11.195489 --- ParallelTerminationStrategy: PID 25568 died... 16:40:11.214227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25568): Terminated: ok {rc=0} 16:40:11.297462 bus /gobi_0: Setting Powered False 16:40:12.395180 bus /gobi_0: Setting Powered False 16:40:13.510017 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 16:40:14.657041 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:14.668733 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:40:14.709232 tst iperf3.py: using LAC 29267 16:40:14.835581 tst iperf3.py: using RAC 197 16:40:14.961081 tst iperf3.py: using CellId 29267 16:40:15.079092 tst iperf3.py: using BVCI 29268 16:40:15.187596 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:15.198509 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:15.209474 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:15.220199 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:15.230754 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:15.241604 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:15.252455 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:15.263288 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:15.274142 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:15.390622 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:40:15.589800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:15.901834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25570): Launched 16:40:16.190318 run iperf3-srv_10.42.42.10(pid=25571): Launched 16:40:16.309640 tst iperf3.py:8: start network... 16:40:16.512428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:16.988585 run create_hlr_db(pid=25572): Launched 16:40:17.136424 bus /gobi_6: Setting Powered False 16:40:18.196863 run create_hlr_db(pid=25572): Terminated: ok {rc=0} 16:40:18.612942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Launched 16:40:18.910673 run osmo-hlr_10.42.42.2(pid=25575): Launched 16:40:19.024068 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:19.545237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Launched 16:40:19.864897 run osmo-stp_10.42.42.5(pid=25578): Launched 16:40:19.985609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:20.536727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25580): Launched 16:40:20.658218 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:20.927319 run patchelf(pid=25581): Launched 16:40:21.104225 run osmo-stp_10.42.42.5(pid=25578): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] 16:40:21.239639 run osmo-stp_10.42.42.5(pid=25578): stdout: | (launched: 2022-12-10_16:40:19.807231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:21.376281 run osmo-stp_10.42.42.5(pid=25578): stderr: | [0;m[38;5;43m20221210164019997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164019997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164019997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164019998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164019998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164019998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164019998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:21.513486 run osmo-stp_10.42.42.5(pid=25578): stdout: | (launched: 2022-12-10_16:40:19.807231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:21.644660 run osmo-stp_10.42.42.5(pid=25578): stderr: | [0;m[38;5;43m20221210164019997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164019997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164019997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164019998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164019998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164019998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164019998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:21.799283 run patchelf(pid=25581): Terminating (SIGINT) 16:40:21.978002 run patchelf(pid=25581): Terminated: ok {rc=0} 16:40:22.106916 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25578): Process ended prematurely: osmo-stp_10.42.42.5(pid=25578) [trial-2376↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] [trial-2376↪gprs:nanobts+band-1900↪iperf3.py:8] 16:40:22.117060 tst iperf3.py:8: Test FAILED (7.5 sec) 16:40:22.145697 run osmo-hlr_10.42.42.2(pid=25575): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25575)] 16:40:22.195470 run osmo-hlr_10.42.42.2(pid=25575): stdout: | (launched: 2022-12-10_16:40:18.855847) 16:40:22.247065 run osmo-hlr_10.42.42.2(pid=25575): stderr: | [0;m[1;31m20221210164019031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164019031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164019031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164019031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164019031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164019031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164019044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164019052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164019052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164019052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:22.298994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25570): Terminating (SIGTERM) 16:40:22.340816 run iperf3-srv_10.42.42.10(pid=25571): Terminating (SIGTERM) 16:40:22.382343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Terminating (SIGTERM) 16:40:22.424502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Terminating (SIGTERM) 16:40:22.466744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25580): Terminating (SIGTERM) 16:40:22.508781 --- ParallelTerminationStrategy: PID 25570 died... 16:40:22.529049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25570): Terminated: ok {rc=0} 16:40:22.575510 --- ParallelTerminationStrategy: PID 25571 died... 16:40:22.595129 run iperf3-srv_10.42.42.10(pid=25571): Terminated {rc=256} 16:40:22.641241 --- ParallelTerminationStrategy: PID 25574 died... 16:40:22.660608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Terminated: ok {rc=0} 16:40:22.707094 --- ParallelTerminationStrategy: PID 25577 died... 16:40:22.726700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Terminated: ok {rc=0} 16:40:22.772640 --- ParallelTerminationStrategy: PID 25580 died... 16:40:22.792327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25580): Terminated: ok {rc=0} 16:40:22.879808 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 16:40:24.029213 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:24.044057 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:40:24.082244 tst iperf3m4.py: using LAC 29268 16:40:24.207022 tst iperf3m4.py: using RAC 198 16:40:24.333361 tst iperf3m4.py: using CellId 29268 16:40:24.458531 tst iperf3m4.py: using BVCI 29269 16:40:24.573896 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:24.585186 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:24.596343 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:24.607436 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:24.618571 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:24.629655 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:24.640819 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:24.651946 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:24.663185 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:24.778303 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:24.896578 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:25.011597 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:25.127770 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:40:25.329503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:25.630524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25582): Launched 16:40:25.889723 run iperf3-srv_10.42.42.10(pid=25583): Launched 16:40:26.001258 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:40:26.201204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:26.501096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25584): Launched 16:40:26.760668 run iperf3-srv_10.42.42.10(pid=25585): Launched 16:40:26.872136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:40:27.070455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:27.370384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25586): Launched 16:40:27.629702 run iperf3-srv_10.42.42.10(pid=25587): Launched 16:40:27.741350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:40:27.940355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:28.239962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25588): Launched 16:40:28.499057 run iperf3-srv_10.42.42.10(pid=25589): Launched 16:40:28.610284 tst iperf3m4.py:8: start network... 16:40:28.808755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:29.268377 run create_hlr_db(pid=25590): Launched 16:40:29.383012 bus /gobi_6: Setting Powered False 16:40:30.443507 run create_hlr_db(pid=25590): Terminated: ok {rc=0} 16:40:30.910134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25592): Launched 16:40:31.245536 run osmo-hlr_10.42.42.2(pid=25593): Launched 16:40:31.403156 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:32.095363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25595): Launched 16:40:32.436366 run osmo-stp_10.42.42.5(pid=25596): Launched 16:40:32.551028 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:33.062885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25598): Launched 16:40:33.177226 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:33.428834 run patchelf(pid=25599): Launched 16:40:33.596224 run osmo-stp_10.42.42.5(pid=25596): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25596)] 16:40:33.722422 run osmo-stp_10.42.42.5(pid=25596): stdout: | (launched: 2022-12-10_16:40:32.381730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:33.850472 run osmo-stp_10.42.42.5(pid=25596): stderr: | [0;m[38;5;43m20221210164032545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164032545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164032545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164032546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164032546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164032546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164032546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:33.978579 run osmo-stp_10.42.42.5(pid=25596): stdout: | (launched: 2022-12-10_16:40:32.381730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:34.100920 run osmo-stp_10.42.42.5(pid=25596): stderr: | [0;m[38;5;43m20221210164032545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164032545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164032545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164032546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164032546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164032546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164032546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:34.245790 run patchelf(pid=25599): Terminating (SIGINT) 16:40:34.414086 run patchelf(pid=25599): Terminated: ok {rc=0} 16:40:34.535255 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25596): Process ended prematurely: osmo-stp_10.42.42.5(pid=25596) [trial-2376↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25596)] [trial-2376↪gprs:nanobts+band-1900↪iperf3m4.py:8] 16:40:34.544594 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:40:34.572118 run osmo-hlr_10.42.42.2(pid=25593): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25593)] 16:40:34.619868 run osmo-hlr_10.42.42.2(pid=25593): stdout: | (launched: 2022-12-10_16:40:31.181280) 16:40:34.669190 run osmo-hlr_10.42.42.2(pid=25593): stderr: | [0;m[1;31m20221210164031552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164031552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164031552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164031552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164031552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164031552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164031580 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164031593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164031594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164031594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:34.718756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25582): Terminating (SIGTERM) 16:40:34.758333 run iperf3-srv_10.42.42.10(pid=25583): Terminating (SIGTERM) 16:40:34.797827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25584): Terminating (SIGTERM) 16:40:34.837463 run iperf3-srv_10.42.42.10(pid=25585): Terminating (SIGTERM) 16:40:34.877171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25586): Terminating (SIGTERM) 16:40:34.916895 run iperf3-srv_10.42.42.10(pid=25587): Terminating (SIGTERM) 16:40:34.956500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25588): Terminating (SIGTERM) 16:40:34.996138 run iperf3-srv_10.42.42.10(pid=25589): Terminating (SIGTERM) 16:40:35.035638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25592): Terminating (SIGTERM) 16:40:35.075284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25595): Terminating (SIGTERM) 16:40:35.114942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25598): Terminating (SIGTERM) 16:40:35.154880 --- ParallelTerminationStrategy: PID 25582 died... 16:40:35.173964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25582): Terminated: ok {rc=0} 16:40:35.218538 --- ParallelTerminationStrategy: PID 25583 died... 16:40:35.237241 run iperf3-srv_10.42.42.10(pid=25583): Terminated {rc=256} 16:40:35.281936 --- ParallelTerminationStrategy: PID 25584 died... 16:40:35.300524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25584): Terminated: ok {rc=0} 16:40:35.345016 --- ParallelTerminationStrategy: PID 25585 died... 16:40:35.363534 run iperf3-srv_10.42.42.10(pid=25585): Terminated {rc=256} 16:40:35.407620 --- ParallelTerminationStrategy: PID 25586 died... 16:40:35.426151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25586): Terminated: ok {rc=0} 16:40:35.470239 --- ParallelTerminationStrategy: PID 25587 died... 16:40:35.488784 run iperf3-srv_10.42.42.10(pid=25587): Terminated {rc=256} 16:40:35.532811 --- ParallelTerminationStrategy: PID 25588 died... 16:40:35.551906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25588): Terminated: ok {rc=0} 16:40:35.596239 --- ParallelTerminationStrategy: PID 25589 died... 16:40:35.614947 run iperf3-srv_10.42.42.10(pid=25589): Terminated {rc=256} 16:40:35.658956 --- ParallelTerminationStrategy: PID 25592 died... 16:40:35.677534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25592): Terminated: ok {rc=0} 16:40:35.721728 --- ParallelTerminationStrategy: PID 25595 died... 16:40:35.740200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25595): Terminated: ok {rc=0} 16:40:35.784518 --- ParallelTerminationStrategy: PID 25598 died... 16:40:35.803228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25598): Terminated: ok {rc=0} 16:40:35.889194 bus /gobi_4: Setting Powered False 16:40:36.988634 bus /gobi_4: Setting Powered False 16:40:38.106422 bus /gobi_1: Setting Powered False 16:40:39.205084 bus /gobi_1: Setting Powered False 16:40:40.320056 bus /gobi_0: Setting Powered False 16:40:41.419248 bus /gobi_0: Setting Powered False 16:40:42.531727 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 16:40:43.633428 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:43.644906 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:40:43.685736 tst ping.py: using LAC 29269 16:40:43.802537 tst ping.py: using RAC 199 16:40:43.919641 tst ping.py: using CellId 29269 16:40:44.034109 tst ping.py: using BVCI 29270 16:40:44.141692 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:44.152216 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:44.162749 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:44.173719 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:44.184229 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:44.194924 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:44.205708 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:44.216411 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:44.328284 tst ping.py:19: start network... 16:40:44.523209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:44.973338 run create_hlr_db(pid=25600): Launched 16:40:45.083872 bus /gobi_6: Setting Powered False 16:40:46.140919 run create_hlr_db(pid=25600): Terminated: ok {rc=0} 16:40:46.564341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25602): Launched 16:40:46.882421 run osmo-hlr_10.42.42.2(pid=25603): Launched 16:40:47.138245 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:47.771310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25605): Launched 16:40:48.082571 run osmo-stp_10.42.42.5(pid=25606): Launched 16:40:48.200416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:48.739518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25608): Launched 16:40:48.858778 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:49.121661 run patchelf(pid=25609): Launched 16:40:49.294709 run osmo-stp_10.42.42.5(pid=25606): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25606)] 16:40:49.427221 run osmo-stp_10.42.42.5(pid=25606): stdout: | (launched: 2022-12-10_16:40:48.025449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:49.561424 run osmo-stp_10.42.42.5(pid=25606): stderr: | [0;m[38;5;43m20221210164048215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164048215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164048216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164048216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164048217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164048217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164048217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:49.694906 run osmo-stp_10.42.42.5(pid=25606): stdout: | (launched: 2022-12-10_16:40:48.025449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:49.822812 run osmo-stp_10.42.42.5(pid=25606): stderr: | [0;m[38;5;43m20221210164048215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164048215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164048216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164048216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164048217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164048217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164048217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:49.974520 run patchelf(pid=25609): Terminating (SIGINT) 16:40:50.149879 run patchelf(pid=25609): Terminated: ok {rc=0} 16:40:50.275949 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25606): Process ended prematurely: osmo-stp_10.42.42.5(pid=25606) [trial-2376↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25606)] [trial-2376↪gprs:nanobts+band-1900↪ping.py:22] 16:40:50.285373 tst ping.py:22: Test FAILED (6.6 sec) 16:40:50.313211 run osmo-hlr_10.42.42.2(pid=25603): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25603)] 16:40:50.362982 run osmo-hlr_10.42.42.2(pid=25603): stdout: | (launched: 2022-12-10_16:40:46.822262) 16:40:50.414233 run osmo-hlr_10.42.42.2(pid=25603): stderr: | [0;m[1;31m20221210164047048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164047048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164047048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164047048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164047048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164047048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164047062 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164047082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164047082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164047082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:50.465778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25602): Terminating (SIGTERM) 16:40:50.507568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25605): Terminating (SIGTERM) 16:40:50.549210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25608): Terminating (SIGTERM) 16:40:50.590994 --- ParallelTerminationStrategy: PID 25602 died... 16:40:50.610981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25602): Terminated: ok {rc=0} 16:40:50.657205 --- ParallelTerminationStrategy: PID 25605 died... 16:40:50.676829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25605): Terminated: ok {rc=0} 16:40:50.722689 --- ParallelTerminationStrategy: PID 25608 died... 16:40:50.742214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25608): Terminated: ok {rc=0} 16:40:50.829594 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 16:40:51.914270 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:51.925691 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:40:51.966293 tst ping_idle_ping.py: using LAC 29270 16:40:52.090626 tst ping_idle_ping.py: using RAC 200 16:40:52.212867 tst ping_idle_ping.py: using CellId 29270 16:40:52.334687 tst ping_idle_ping.py: using BVCI 29271 16:40:52.447757 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:52.458974 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:52.470133 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:52.481225 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:52.492447 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:52.503479 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:52.514644 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:52.525826 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:52.637848 tst ping_idle_ping.py:24: start network... 16:40:52.833946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:53.288826 run create_hlr_db(pid=25610): Launched 16:40:53.401981 bus /gobi_6: Setting Powered False 16:40:54.460906 run create_hlr_db(pid=25610): Terminated: ok {rc=0} 16:40:54.892155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25612): Launched 16:40:55.206296 run osmo-hlr_10.42.42.2(pid=25613): Launched 16:40:55.324817 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:55.868007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25615): Launched 16:40:56.180669 run osmo-stp_10.42.42.5(pid=25616): Launched 16:40:56.299356 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:56.840122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25618): Launched 16:40:56.959795 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:57.224294 run patchelf(pid=25619): Launched 16:40:57.398097 run osmo-stp_10.42.42.5(pid=25616): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25616)] 16:40:57.531378 run osmo-stp_10.42.42.5(pid=25616): stdout: | (launched: 2022-12-10_16:40:56.123199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:57.665826 run osmo-stp_10.42.42.5(pid=25616): stderr: | [0;m[38;5;43m20221210164056313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164056313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164056314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164056314 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164056315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164056315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164056315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:57.799683 run osmo-stp_10.42.42.5(pid=25616): stdout: | (launched: 2022-12-10_16:40:56.123199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:57.927962 run osmo-stp_10.42.42.5(pid=25616): stderr: | [0;m[38;5;43m20221210164056313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164056313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164056314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164056314 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164056315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164056315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164056315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:58.079677 run patchelf(pid=25619): Terminating (SIGINT) 16:40:58.254868 run patchelf(pid=25619): Terminated: ok {rc=0} 16:40:58.380938 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25616): Process ended prematurely: osmo-stp_10.42.42.5(pid=25616) [trial-2376↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25616)] [trial-2376↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 16:40:58.390321 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:40:58.418410 run osmo-hlr_10.42.42.2(pid=25613): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25613)] 16:40:58.468126 run osmo-hlr_10.42.42.2(pid=25613): stdout: | (launched: 2022-12-10_16:40:55.148776) 16:40:58.520131 run osmo-hlr_10.42.42.2(pid=25613): stderr: | [0;m[1;31m20221210164055345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164055345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164055345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164055345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164055345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164055345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164055358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164055366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164055366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164055366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:58.572010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25612): Terminating (SIGTERM) 16:40:58.613838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25615): Terminating (SIGTERM) 16:40:58.655747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25618): Terminating (SIGTERM) 16:40:58.697839 --- ParallelTerminationStrategy: PID 25612 died... 16:40:58.717873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25612): Terminated: ok {rc=0} 16:40:58.764063 --- ParallelTerminationStrategy: PID 25615 died... 16:40:58.783432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25615): Terminated: ok {rc=0} 16:40:58.829485 --- ParallelTerminationStrategy: PID 25618 died... 16:40:58.848724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25618): Terminated: ok {rc=0} 16:40:58.935591 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 16:41:00.230447 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:41:00.236777 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:41:00.262407 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:41:00.303421 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:41:00.391620 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:41:00.416071 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:41:00.454938 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:41:01.053279 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:41:01.106565 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:01.118094 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:41:01.158216 tst cs_paging_gprs_active.py: using LAC 29271 16:41:01.312356 tst cs_paging_gprs_active.py: using RAC 201 16:41:01.436516 tst cs_paging_gprs_active.py: using CellId 29271 16:41:01.578171 tst cs_paging_gprs_active.py: using BVCI 29272 16:41:01.725065 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:01.739905 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:01.751258 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:01.770695 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:01.784019 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:01.798378 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:01.811648 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:01.824757 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:01.836809 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:01.979840 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:02.102528 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:41:02.343475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:02.642661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25623): Launched 16:41:02.901753 run iperf3-srv_10.42.42.10(pid=25624): Launched 16:41:03.013632 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:41:03.213704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:03.512727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25625): Launched 16:41:03.771339 run iperf3-srv_10.42.42.10(pid=25626): Launched 16:41:03.882519 tst cs_paging_gprs_active.py:38: start network... 16:41:04.082082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:04.540779 run create_hlr_db(pid=25627): Launched 16:41:04.653670 bus /gobi_6: Setting Powered False 16:41:05.713570 run create_hlr_db(pid=25627): Terminated: ok {rc=0} 16:41:06.148262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25629): Launched 16:41:06.466055 run osmo-hlr_10.42.42.2(pid=25630): Launched 16:41:06.587100 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:07.138264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25632): Launched 16:41:07.454777 run osmo-stp_10.42.42.5(pid=25633): Launched 16:41:07.576904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:08.123318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25635): Launched 16:41:08.244827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:08.513351 run patchelf(pid=25636): Launched 16:41:08.690120 run osmo-stp_10.42.42.5(pid=25633): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25633)] 16:41:08.825082 run osmo-stp_10.42.42.5(pid=25633): stdout: | (launched: 2022-12-10_16:41:07.396857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:08.961833 run osmo-stp_10.42.42.5(pid=25633): stderr: | [0;m[38;5;43m20221210164107586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164107586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164107587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164107587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164107588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164107588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164107588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:09.098765 run osmo-stp_10.42.42.5(pid=25633): stdout: | (launched: 2022-12-10_16:41:07.396857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:09.229140 run osmo-stp_10.42.42.5(pid=25633): stderr: | [0;m[38;5;43m20221210164107586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164107586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164107587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164107587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164107588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164107588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164107588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:09.383669 run patchelf(pid=25636): Terminating (SIGINT) 16:41:09.563377 run patchelf(pid=25636): Terminated: ok {rc=0} 16:41:09.692271 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25633): Process ended prematurely: osmo-stp_10.42.42.5(pid=25633) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25633)] [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:41:09.702357 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:41:09.730678 run osmo-hlr_10.42.42.2(pid=25630): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25630)] 16:41:09.780266 run osmo-hlr_10.42.42.2(pid=25630): stdout: | (launched: 2022-12-10_16:41:06.408125) 16:41:09.831769 run osmo-hlr_10.42.42.2(pid=25630): stderr: | [0;m[1;31m20221210164106604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164106604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164106604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164106604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164106604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164106604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164106617 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164106625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164106626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164106626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:09.883709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25623): Terminating (SIGTERM) 16:41:09.925254 run iperf3-srv_10.42.42.10(pid=25624): Terminating (SIGTERM) 16:41:09.966678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25625): Terminating (SIGTERM) 16:41:10.008288 run iperf3-srv_10.42.42.10(pid=25626): Terminating (SIGTERM) 16:41:10.049794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25629): Terminating (SIGTERM) 16:41:10.091396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25632): Terminating (SIGTERM) 16:41:10.133026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25635): Terminating (SIGTERM) 16:41:10.174670 --- ParallelTerminationStrategy: PID 25623 died... 16:41:10.194644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25623): Terminated: ok {rc=0} 16:41:10.240913 --- ParallelTerminationStrategy: PID 25624 died... 16:41:10.260766 run iperf3-srv_10.42.42.10(pid=25624): Terminated {rc=256} 16:41:10.306764 --- ParallelTerminationStrategy: PID 25625 died... 16:41:10.326431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25625): Terminated: ok {rc=0} 16:41:10.372328 --- ParallelTerminationStrategy: PID 25626 died... 16:41:10.391765 run iperf3-srv_10.42.42.10(pid=25626): Terminated {rc=256} 16:41:10.437591 --- ParallelTerminationStrategy: PID 25629 died... 16:41:10.457166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25629): Terminated: ok {rc=0} 16:41:10.503274 --- ParallelTerminationStrategy: PID 25632 died... 16:41:10.522777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25632): Terminated: ok {rc=0} 16:41:10.568849 --- ParallelTerminationStrategy: PID 25635 died... 16:41:10.588772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25635): Terminated: ok {rc=0} 16:41:10.675899 bus /gobi_0: Setting Powered False 16:41:11.773220 bus /gobi_0: Setting Powered False 16:41:12.888598 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:41:14.033598 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:14.045115 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:41:14.091521 tst iperf3.py: using LAC 29272 16:41:14.216298 tst iperf3.py: using RAC 202 16:41:14.340526 tst iperf3.py: using CellId 29272 16:41:14.463814 tst iperf3.py: using BVCI 29273 16:41:14.579468 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:14.590994 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:14.602421 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:14.613610 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:14.624662 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:14.635833 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:14.647180 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:14.658444 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:14.669794 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:14.785415 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:41:14.999312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:15.318747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25637): Launched 16:41:15.596882 run iperf3-srv_10.42.42.10(pid=25638): Launched 16:41:15.715858 tst iperf3.py:8: start network... 16:41:15.947607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:16.452801 run create_hlr_db(pid=25639): Launched 16:41:16.610333 bus /gobi_6: Setting Powered False 16:41:17.670316 run create_hlr_db(pid=25639): Terminated: ok {rc=0} 16:41:18.113279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25641): Launched 16:41:18.430065 run osmo-hlr_10.42.42.2(pid=25642): Launched 16:41:18.550869 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:19.098099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25644): Launched 16:41:19.415328 run osmo-stp_10.42.42.5(pid=25645): Launched 16:41:19.536676 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:20.086711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25647): Launched 16:41:20.207951 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:20.476038 run patchelf(pid=25648): Launched 16:41:20.652732 run osmo-stp_10.42.42.5(pid=25645): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25645)] 16:41:20.787560 run osmo-stp_10.42.42.5(pid=25645): stdout: | (launched: 2022-12-10_16:41:19.357249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:20.924204 run osmo-stp_10.42.42.5(pid=25645): stderr: | [0;m[38;5;43m20221210164119547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164119547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164119547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164119548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164119548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164119548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164119548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:21.061179 run osmo-stp_10.42.42.5(pid=25645): stdout: | (launched: 2022-12-10_16:41:19.357249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:21.191450 run osmo-stp_10.42.42.5(pid=25645): stderr: | [0;m[38;5;43m20221210164119547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164119547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164119547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164119548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164119548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164119548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164119548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:21.345827 run patchelf(pid=25648): Terminating (SIGINT) 16:41:21.524751 run patchelf(pid=25648): Terminated: ok {rc=0} 16:41:21.654354 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25645): Process ended prematurely: osmo-stp_10.42.42.5(pid=25645) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25645)] [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 16:41:21.664267 tst iperf3.py:8: Test FAILED (7.7 sec) 16:41:21.692794 run osmo-hlr_10.42.42.2(pid=25642): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25642)] 16:41:21.742542 run osmo-hlr_10.42.42.2(pid=25642): stdout: | (launched: 2022-12-10_16:41:18.372153) 16:41:21.794148 run osmo-hlr_10.42.42.2(pid=25642): stderr: | [0;m[1;31m20221210164118568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164118568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164118568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164118568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164118568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164118568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164118581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164118589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164118589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164118589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:21.846058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25637): Terminating (SIGTERM) 16:41:21.887801 run iperf3-srv_10.42.42.10(pid=25638): Terminating (SIGTERM) 16:41:21.929720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25641): Terminating (SIGTERM) 16:41:21.971683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25644): Terminating (SIGTERM) 16:41:22.013592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25647): Terminating (SIGTERM) 16:41:22.055859 --- ParallelTerminationStrategy: PID 25637 died... 16:41:22.076012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25637): Terminated: ok {rc=0} 16:41:22.123008 --- ParallelTerminationStrategy: PID 25638 died... 16:41:22.142526 run iperf3-srv_10.42.42.10(pid=25638): Terminated {rc=256} 16:41:22.188531 --- ParallelTerminationStrategy: PID 25641 died... 16:41:22.208145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25641): Terminated: ok {rc=0} 16:41:22.254348 --- ParallelTerminationStrategy: PID 25644 died... 16:41:22.273877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25644): Terminated: ok {rc=0} 16:41:22.320074 --- ParallelTerminationStrategy: PID 25647 died... 16:41:22.339701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25647): Terminated: ok {rc=0} 16:41:22.427583 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:41:23.577708 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:23.592458 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:41:23.631281 tst iperf3m4.py: using LAC 29273 16:41:23.749648 tst iperf3m4.py: using RAC 203 16:41:23.874610 tst iperf3m4.py: using CellId 29273 16:41:23.998790 tst iperf3m4.py: using BVCI 29274 16:41:24.114860 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:24.126380 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:24.137637 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:24.148764 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:24.159930 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:24.171111 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:24.182518 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:24.193693 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:24.205486 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:24.322386 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:24.443155 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:24.558623 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:24.677590 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:41:24.891835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:25.210092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25649): Launched 16:41:25.486400 run iperf3-srv_10.42.42.10(pid=25650): Launched 16:41:25.605795 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:41:25.820602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:26.138964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25651): Launched 16:41:26.414951 run iperf3-srv_10.42.42.10(pid=25652): Launched 16:41:26.533797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:41:26.747444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:27.065541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25653): Launched 16:41:27.342230 run iperf3-srv_10.42.42.10(pid=25654): Launched 16:41:27.460631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:41:27.675138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:27.993495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25655): Launched 16:41:28.270065 run iperf3-srv_10.42.42.10(pid=25656): Launched 16:41:28.388503 tst iperf3m4.py:8: start network... 16:41:28.602774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:29.094082 run create_hlr_db(pid=25657): Launched 16:41:29.222373 bus /gobi_6: Setting Powered False 16:41:30.286156 run create_hlr_db(pid=25657): Terminated: ok {rc=0} 16:41:30.712511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25659): Launched 16:41:31.033786 run osmo-hlr_10.42.42.2(pid=25660): Launched 16:41:31.277041 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:31.867802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25662): Launched 16:41:32.197726 run osmo-stp_10.42.42.5(pid=25663): Launched 16:41:32.352405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:32.879572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25665): Launched 16:41:32.994383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:33.247212 run patchelf(pid=25666): Launched 16:41:33.413263 run osmo-stp_10.42.42.5(pid=25663): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25663)] 16:41:33.539434 run osmo-stp_10.42.42.5(pid=25663): stdout: | (launched: 2022-12-10_16:41:32.128596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:33.667180 run osmo-stp_10.42.42.5(pid=25663): stderr: | [0;m[38;5;43m20221210164132344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164132344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164132345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164132345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164132345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164132346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164132346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:33.795214 run osmo-stp_10.42.42.5(pid=25663): stdout: | (launched: 2022-12-10_16:41:32.128596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:33.917155 run osmo-stp_10.42.42.5(pid=25663): stderr: | [0;m[38;5;43m20221210164132344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164132344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164132345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164132345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164132345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164132346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164132346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:34.061129 run patchelf(pid=25666): Terminating (SIGINT) 16:41:34.228375 run patchelf(pid=25666): Terminated: ok {rc=0} 16:41:34.349201 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25663): Process ended prematurely: osmo-stp_10.42.42.5(pid=25663) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25663)] [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 16:41:34.358571 tst iperf3m4.py:8: Test FAILED (10.8 sec) 16:41:34.386530 run osmo-hlr_10.42.42.2(pid=25660): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25660)] 16:41:34.433954 run osmo-hlr_10.42.42.2(pid=25660): stdout: | (launched: 2022-12-10_16:41:30.970232) 16:41:34.483021 run osmo-hlr_10.42.42.2(pid=25660): stderr: | [0;m[1;31m20221210164131208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164131208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164131208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164131208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164131213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164131213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164131227 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164131243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164131244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164131244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:34.532658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25649): Terminating (SIGTERM) 16:41:34.572236 run iperf3-srv_10.42.42.10(pid=25650): Terminating (SIGTERM) 16:41:34.611829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25651): Terminating (SIGTERM) 16:41:34.651306 run iperf3-srv_10.42.42.10(pid=25652): Terminating (SIGTERM) 16:41:34.690836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25653): Terminating (SIGTERM) 16:41:34.730383 run iperf3-srv_10.42.42.10(pid=25654): Terminating (SIGTERM) 16:41:34.769632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25655): Terminating (SIGTERM) 16:41:34.809171 run iperf3-srv_10.42.42.10(pid=25656): Terminating (SIGTERM) 16:41:34.848839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25659): Terminating (SIGTERM) 16:41:34.888275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25662): Terminating (SIGTERM) 16:41:34.927658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25665): Terminating (SIGTERM) 16:41:34.967520 --- ParallelTerminationStrategy: PID 25649 died... 16:41:34.986554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25649): Terminated: ok {rc=0} 16:41:35.031500 --- ParallelTerminationStrategy: PID 25650 died... 16:41:35.049981 run iperf3-srv_10.42.42.10(pid=25650): Terminated {rc=256} 16:41:35.093936 --- ParallelTerminationStrategy: PID 25651 died... 16:41:35.112371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25651): Terminated: ok {rc=0} 16:41:35.156261 --- ParallelTerminationStrategy: PID 25652 died... 16:41:35.174646 run iperf3-srv_10.42.42.10(pid=25652): Terminated {rc=256} 16:41:35.218430 --- ParallelTerminationStrategy: PID 25653 died... 16:41:35.236896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25653): Terminated: ok {rc=0} 16:41:35.280925 --- ParallelTerminationStrategy: PID 25654 died... 16:41:35.299349 run iperf3-srv_10.42.42.10(pid=25654): Terminated {rc=256} 16:41:35.343294 --- ParallelTerminationStrategy: PID 25655 died... 16:41:35.361836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25655): Terminated: ok {rc=0} 16:41:35.406207 --- ParallelTerminationStrategy: PID 25656 died... 16:41:35.424494 run iperf3-srv_10.42.42.10(pid=25656): Terminated {rc=256} 16:41:35.468587 --- ParallelTerminationStrategy: PID 25659 died... 16:41:35.487091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25659): Terminated: ok {rc=0} 16:41:35.531152 --- ParallelTerminationStrategy: PID 25662 died... 16:41:35.549733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25662): Terminated: ok {rc=0} 16:41:35.594360 --- ParallelTerminationStrategy: PID 25665 died... 16:41:35.613476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25665): Terminated: ok {rc=0} 16:41:35.699748 bus /gobi_4: Setting Powered False 16:41:36.799903 bus /gobi_4: Setting Powered False 16:41:37.912254 bus /gobi_1: Setting Powered False 16:41:39.008132 bus /gobi_1: Setting Powered False 16:41:40.122837 bus /gobi_0: Setting Powered False 16:41:41.221133 bus /gobi_0: Setting Powered False 16:41:42.336721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 16:41:43.439802 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:43.451306 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:41:43.490534 tst ping.py: using LAC 29274 16:41:43.605097 tst ping.py: using RAC 204 16:41:43.717802 tst ping.py: using CellId 29274 16:41:43.830595 tst ping.py: using BVCI 29275 16:41:43.935886 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:43.946792 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:43.957632 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:43.968508 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:43.979348 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:43.990196 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:44.001299 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:44.012185 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:44.127960 tst ping.py:19: start network... 16:41:44.337762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:44.818975 run create_hlr_db(pid=25667): Launched 16:41:44.945690 bus /gobi_6: Setting Powered False 16:41:46.008193 run create_hlr_db(pid=25667): Terminated: ok {rc=0} 16:41:46.484748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25669): Launched 16:41:46.825768 run osmo-hlr_10.42.42.2(pid=25670): Launched 16:41:46.979925 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:47.614872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25672): Launched 16:41:47.906026 run osmo-stp_10.42.42.5(pid=25673): Launched 16:41:48.016515 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:48.520115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25675): Launched 16:41:48.631844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:48.878232 run patchelf(pid=25676): Launched 16:41:49.040058 run osmo-stp_10.42.42.5(pid=25673): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25673)] 16:41:49.163653 run osmo-stp_10.42.42.5(pid=25673): stdout: | (launched: 2022-12-10_16:41:47.852129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:49.288385 run osmo-stp_10.42.42.5(pid=25673): stderr: | [0;m[38;5;43m20221210164148023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164148023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164148023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164148023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164148024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164148024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164148024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:49.414016 run osmo-stp_10.42.42.5(pid=25673): stdout: | (launched: 2022-12-10_16:41:47.852129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:49.533533 run osmo-stp_10.42.42.5(pid=25673): stderr: | [0;m[38;5;43m20221210164148023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164148023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164148023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164148023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164148024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164148024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164148024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:49.674842 run patchelf(pid=25676): Terminating (SIGINT) 16:41:49.838513 run patchelf(pid=25676): Terminated: ok {rc=0} 16:41:49.956590 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25673): Process ended prematurely: osmo-stp_10.42.42.5(pid=25673) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25673)] [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 16:41:49.965521 tst ping.py:22: Test FAILED (6.5 sec) 16:41:49.992725 run osmo-hlr_10.42.42.2(pid=25670): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25670)] 16:41:50.039972 run osmo-hlr_10.42.42.2(pid=25670): stdout: | (launched: 2022-12-10_16:41:46.763077) 16:41:50.089283 run osmo-hlr_10.42.42.2(pid=25670): stderr: | [0;m[1;31m20221210164147146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164147146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164147146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164147146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164147146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164147146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164147166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164147188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164147189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164147190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:50.138882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25669): Terminating (SIGTERM) 16:41:50.178644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25672): Terminating (SIGTERM) 16:41:50.218277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25675): Terminating (SIGTERM) 16:41:50.258263 --- ParallelTerminationStrategy: PID 25669 died... 16:41:50.277375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25669): Terminated: ok {rc=0} 16:41:50.321894 --- ParallelTerminationStrategy: PID 25672 died... 16:41:50.340290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25672): Terminated: ok {rc=0} 16:41:50.385225 --- ParallelTerminationStrategy: PID 25675 died... 16:41:50.403754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25675): Terminated: ok {rc=0} 16:41:50.488985 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:41:51.577768 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:51.589928 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:41:51.632117 tst ping_idle_ping.py: using LAC 29275 16:41:51.748271 tst ping_idle_ping.py: using RAC 205 16:41:51.862657 tst ping_idle_ping.py: using CellId 29275 16:41:51.979038 tst ping_idle_ping.py: using BVCI 29276 16:41:52.084690 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:52.095775 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:52.106607 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:52.117699 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:52.128665 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:52.139683 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:52.150891 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:52.161879 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:52.277566 tst ping_idle_ping.py:24: start network... 16:41:52.487944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:52.980075 run create_hlr_db(pid=25677): Launched 16:41:53.108171 bus /gobi_6: Setting Powered False 16:41:54.171588 run create_hlr_db(pid=25677): Terminated: ok {rc=0} 16:41:54.596387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25679): Launched 16:41:54.890584 run osmo-hlr_10.42.42.2(pid=25680): Launched 16:41:55.002067 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:55.514549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25682): Launched 16:41:55.807468 run osmo-stp_10.42.42.5(pid=25683): Launched 16:41:55.918952 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:56.424104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25685): Launched 16:41:56.536018 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:56.782853 run patchelf(pid=25686): Launched 16:41:56.944637 run osmo-stp_10.42.42.5(pid=25683): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25683)] 16:41:57.068399 run osmo-stp_10.42.42.5(pid=25683): stdout: | (launched: 2022-12-10_16:41:55.752812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:57.193904 run osmo-stp_10.42.42.5(pid=25683): stderr: | [0;m[38;5;43m20221210164155922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164155922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164155922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164155923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164155923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164155923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164155924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:57.319630 run osmo-stp_10.42.42.5(pid=25683): stdout: | (launched: 2022-12-10_16:41:55.752812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:57.439928 run osmo-stp_10.42.42.5(pid=25683): stderr: | [0;m[38;5;43m20221210164155922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164155922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164155922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164155923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164155923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164155923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164155924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:57.582082 run patchelf(pid=25686): Terminating (SIGINT) 16:41:57.746655 run patchelf(pid=25686): Terminated: ok {rc=0} 16:41:57.865606 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25683): Process ended prematurely: osmo-stp_10.42.42.5(pid=25683) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25683)] [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 16:41:57.874270 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 16:41:57.901273 run osmo-hlr_10.42.42.2(pid=25680): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25680)] 16:41:57.949504 run osmo-hlr_10.42.42.2(pid=25680): stdout: | (launched: 2022-12-10_16:41:54.836790) 16:41:57.998873 run osmo-hlr_10.42.42.2(pid=25680): stderr: | [0;m[1;31m20221210164155010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164155010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164155011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164155011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164155011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164155011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164155023 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164155032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164155032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164155032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:58.048611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25679): Terminating (SIGTERM) 16:41:58.088535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25682): Terminating (SIGTERM) 16:41:58.128261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25685): Terminating (SIGTERM) 16:41:58.168257 --- ParallelTerminationStrategy: PID 25679 died... 16:41:58.187371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25679): Terminated: ok {rc=0} 16:41:58.231769 --- ParallelTerminationStrategy: PID 25682 died... 16:41:58.250283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25682): Terminated: ok {rc=0} 16:41:58.294386 --- ParallelTerminationStrategy: PID 25685 died... 16:41:58.312849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25685): Terminated: ok {rc=0} 16:41:58.396998 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:41:59.694499 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:41:59.702456 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:41:59.727086 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:41:59.766185 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:41:59.856585 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:41:59.881532 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:41:59.920438 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:42:00.510323 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:42:00.558994 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:00.570120 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:42:00.629102 tst cs_paging_gprs_active.py: using LAC 29276 16:42:00.751177 tst cs_paging_gprs_active.py: using RAC 206 16:42:00.894369 tst cs_paging_gprs_active.py: using CellId 29276 16:42:01.045201 tst cs_paging_gprs_active.py: using BVCI 29277 16:42:01.166656 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:01.178750 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:01.190789 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:01.204262 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:01.216616 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:01.229860 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:01.242369 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:01.254591 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:01.267270 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:01.390122 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:01.504802 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:42:01.712387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:02.025420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25697): Launched 16:42:02.301334 run iperf3-srv_10.42.42.10(pid=25698): Launched 16:42:02.413649 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:42:02.614446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:02.914062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25699): Launched 16:42:03.173549 run iperf3-srv_10.42.42.10(pid=25700): Launched 16:42:03.285163 tst cs_paging_gprs_active.py:38: start network... 16:42:03.485202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:03.946056 run create_hlr_db(pid=25701): Launched 16:42:04.060109 bus /gobi_6: Setting Powered False 16:42:05.120153 run create_hlr_db(pid=25701): Terminated: ok {rc=0} 16:42:05.555821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25703): Launched 16:42:05.875480 run osmo-hlr_10.42.42.2(pid=25704): Launched 16:42:05.997423 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:06.544275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25706): Launched 16:42:06.862148 run osmo-stp_10.42.42.5(pid=25707): Launched 16:42:06.982561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:07.531692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25709): Launched 16:42:07.653225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:07.921848 run patchelf(pid=25710): Launched 16:42:08.098963 run osmo-stp_10.42.42.5(pid=25707): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25707)] 16:42:08.233237 run osmo-stp_10.42.42.5(pid=25707): stdout: | (launched: 2022-12-10_16:42:06.804083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:08.370154 run osmo-stp_10.42.42.5(pid=25707): stderr: | [0;m[38;5;43m20221210164206992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164206993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164206993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164206993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164206994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164206994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164206994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:08.506883 run osmo-stp_10.42.42.5(pid=25707): stdout: | (launched: 2022-12-10_16:42:06.804083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:08.637712 run osmo-stp_10.42.42.5(pid=25707): stderr: | [0;m[38;5;43m20221210164206992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164206993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164206993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164206993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164206994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164206994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164206994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:08.791865 run patchelf(pid=25710): Terminating (SIGINT) 16:42:08.970462 run patchelf(pid=25710): Terminated: ok {rc=0} 16:42:09.099183 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25707): Process ended prematurely: osmo-stp_10.42.42.5(pid=25707) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25707)] [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:42:09.109540 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:42:09.138011 run osmo-hlr_10.42.42.2(pid=25704): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25704)] 16:42:09.187694 run osmo-hlr_10.42.42.2(pid=25704): stdout: | (launched: 2022-12-10_16:42:05.817633) 16:42:09.239033 run osmo-hlr_10.42.42.2(pid=25704): stderr: | [0;m[1;31m20221210164206016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164206016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164206016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164206016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164206016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164206016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164206028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164206036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164206037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164206037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:09.291073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25697): Terminating (SIGTERM) 16:42:09.332869 run iperf3-srv_10.42.42.10(pid=25698): Terminating (SIGTERM) 16:42:09.374681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25699): Terminating (SIGTERM) 16:42:09.416330 run iperf3-srv_10.42.42.10(pid=25700): Terminating (SIGTERM) 16:42:09.458020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25703): Terminating (SIGTERM) 16:42:09.499842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25706): Terminating (SIGTERM) 16:42:09.541907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25709): Terminating (SIGTERM) 16:42:09.584134 --- ParallelTerminationStrategy: PID 25697 died... 16:42:09.604122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25697): Terminated: ok {rc=0} 16:42:09.650522 --- ParallelTerminationStrategy: PID 25698 died... 16:42:09.670032 run iperf3-srv_10.42.42.10(pid=25698): Terminated {rc=256} 16:42:09.715822 --- ParallelTerminationStrategy: PID 25699 died... 16:42:09.735271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25699): Terminated: ok {rc=0} 16:42:09.781197 --- ParallelTerminationStrategy: PID 25700 died... 16:42:09.800355 run iperf3-srv_10.42.42.10(pid=25700): Terminated {rc=256} 16:42:09.846476 --- ParallelTerminationStrategy: PID 25703 died... 16:42:09.866013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25703): Terminated: ok {rc=0} 16:42:09.911847 --- ParallelTerminationStrategy: PID 25706 died... 16:42:09.931322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25706): Terminated: ok {rc=0} 16:42:09.977177 --- ParallelTerminationStrategy: PID 25709 died... 16:42:09.996794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25709): Terminated: ok {rc=0} 16:42:10.084330 bus /gobi_0: Setting Powered False 16:42:11.183035 bus /gobi_0: Setting Powered False 16:42:12.298690 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:42:13.443793 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:13.455407 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:42:13.517628 tst iperf3.py: using LAC 29277 16:42:13.645080 tst iperf3.py: using RAC 207 16:42:13.769432 tst iperf3.py: using CellId 29277 16:42:13.893540 tst iperf3.py: using BVCI 29278 16:42:14.008432 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:14.019935 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:14.031432 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:14.042871 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:14.054272 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:14.065668 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:14.077083 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:14.088299 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:14.099958 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:14.216168 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:42:14.431981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:14.750789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25711): Launched 16:42:15.027185 run iperf3-srv_10.42.42.10(pid=25712): Launched 16:42:15.146350 tst iperf3.py:8: start network... 16:42:15.360591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:15.870335 run create_hlr_db(pid=25713): Launched 16:42:16.049976 bus /gobi_6: Setting Powered False 16:42:17.117799 run create_hlr_db(pid=25713): Terminated: ok {rc=0} 16:42:17.565653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25715): Launched 16:42:17.883075 run osmo-hlr_10.42.42.2(pid=25716): Launched 16:42:18.002698 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:18.550226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25718): Launched 16:42:18.867326 run osmo-stp_10.42.42.5(pid=25719): Launched 16:42:18.987687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:19.535016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25721): Launched 16:42:19.657180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:19.924748 run patchelf(pid=25722): Launched 16:42:20.101374 run osmo-stp_10.42.42.5(pid=25719): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25719)] 16:42:20.235908 run osmo-stp_10.42.42.5(pid=25719): stdout: | (launched: 2022-12-10_16:42:18.809466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:20.372021 run osmo-stp_10.42.42.5(pid=25719): stderr: | [0;m[38;5;43m20221210164218999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164218999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164218999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164219000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164219000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164219000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164219000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:20.508382 run osmo-stp_10.42.42.5(pid=25719): stdout: | (launched: 2022-12-10_16:42:18.809466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:20.638967 run osmo-stp_10.42.42.5(pid=25719): stderr: | [0;m[38;5;43m20221210164218999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164218999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164218999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164219000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164219000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164219000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164219000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:20.793108 run patchelf(pid=25722): Terminating (SIGINT) 16:42:20.971489 run patchelf(pid=25722): Terminated: ok {rc=0} 16:42:21.099950 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25719): Process ended prematurely: osmo-stp_10.42.42.5(pid=25719) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25719)] [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 16:42:21.110031 tst iperf3.py:8: Test FAILED (7.7 sec) 16:42:21.138684 run osmo-hlr_10.42.42.2(pid=25716): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25716)] 16:42:21.188350 run osmo-hlr_10.42.42.2(pid=25716): stdout: | (launched: 2022-12-10_16:42:17.825378) 16:42:21.239987 run osmo-hlr_10.42.42.2(pid=25716): stderr: | [0;m[1;31m20221210164218024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164218024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164218024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164218024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164218024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164218024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164218041 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164218049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164218049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164218049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:21.291805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25711): Terminating (SIGTERM) 16:42:21.333568 run iperf3-srv_10.42.42.10(pid=25712): Terminating (SIGTERM) 16:42:21.375170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25715): Terminating (SIGTERM) 16:42:21.416738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25718): Terminating (SIGTERM) 16:42:21.458310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25721): Terminating (SIGTERM) 16:42:21.500214 --- ParallelTerminationStrategy: PID 25711 died... 16:42:21.520177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25711): Terminated: ok {rc=0} 16:42:21.566527 --- ParallelTerminationStrategy: PID 25712 died... 16:42:21.586188 run iperf3-srv_10.42.42.10(pid=25712): Terminated {rc=256} 16:42:21.632709 --- ParallelTerminationStrategy: PID 25715 died... 16:42:21.652276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25715): Terminated: ok {rc=0} 16:42:21.698141 --- ParallelTerminationStrategy: PID 25718 died... 16:42:21.717698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25718): Terminated: ok {rc=0} 16:42:21.763522 --- ParallelTerminationStrategy: PID 25721 died... 16:42:21.783059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25721): Terminated: ok {rc=0} 16:42:21.869475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:42:23.015637 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:23.027335 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:42:23.087323 tst iperf3m4.py: using LAC 29278 16:42:23.206004 tst iperf3m4.py: using RAC 208 16:42:23.323863 tst iperf3m4.py: using CellId 29278 16:42:23.438969 tst iperf3m4.py: using BVCI 29279 16:42:23.547145 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:23.558264 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:23.569324 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:23.580309 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:23.591166 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:23.602215 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:23.613856 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:23.624802 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:23.635937 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:23.754882 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:23.874120 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:23.988918 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:24.106558 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:42:24.306708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:24.606907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25723): Launched 16:42:24.866955 run iperf3-srv_10.42.42.10(pid=25724): Launched 16:42:24.978800 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:42:25.178387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:25.477658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25725): Launched 16:42:25.737752 run iperf3-srv_10.42.42.10(pid=25726): Launched 16:42:25.849239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:42:26.048016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:26.347038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25727): Launched 16:42:26.606927 run iperf3-srv_10.42.42.10(pid=25728): Launched 16:42:26.727487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:42:26.942285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:27.263066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25729): Launched 16:42:27.540630 run iperf3-srv_10.42.42.10(pid=25730): Launched 16:42:27.659751 tst iperf3m4.py:8: start network... 16:42:27.873824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:28.367249 run create_hlr_db(pid=25731): Launched 16:42:28.496588 bus /gobi_6: Setting Powered False 16:42:29.560268 run create_hlr_db(pid=25731): Terminated: ok {rc=0} 16:42:30.004538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25733): Launched 16:42:30.323297 run osmo-hlr_10.42.42.2(pid=25734): Launched 16:42:30.443365 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:31.010298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25736): Launched 16:42:31.361688 run osmo-stp_10.42.42.5(pid=25737): Launched 16:42:31.655277 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:32.241201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25739): Launched 16:42:32.365573 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:32.619624 run patchelf(pid=25740): Launched 16:42:32.785328 run osmo-stp_10.42.42.5(pid=25737): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25737)] 16:42:32.911794 run osmo-stp_10.42.42.5(pid=25737): stdout: | (launched: 2022-12-10_16:42:31.296050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:33.040131 run osmo-stp_10.42.42.5(pid=25737): stderr: | [0;m[38;5;43m20221210164231548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164231548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164231548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164231549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164231549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164231549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164231549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:33.168675 run osmo-stp_10.42.42.5(pid=25737): stdout: | (launched: 2022-12-10_16:42:31.296050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:33.291090 run osmo-stp_10.42.42.5(pid=25737): stderr: | [0;m[38;5;43m20221210164231548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164231548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164231548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164231549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164231549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164231549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164231549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:33.436223 run patchelf(pid=25740): Terminating (SIGINT) 16:42:33.604590 run patchelf(pid=25740): Terminated: ok {rc=0} 16:42:33.725785 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25737): Process ended prematurely: osmo-stp_10.42.42.5(pid=25737) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25737)] [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:42:33.735231 tst iperf3m4.py:8: Test FAILED (10.8 sec) 16:42:33.763450 run osmo-hlr_10.42.42.2(pid=25734): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25734)] 16:42:33.811575 run osmo-hlr_10.42.42.2(pid=25734): stdout: | (launched: 2022-12-10_16:42:30.264860) 16:42:33.861283 run osmo-hlr_10.42.42.2(pid=25734): stderr: | [0;m[1;31m20221210164230462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164230462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164230462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164230462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164230462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164230462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164230474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164230483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164230483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164230483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:33.911652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25723): Terminating (SIGTERM) 16:42:33.951689 run iperf3-srv_10.42.42.10(pid=25724): Terminating (SIGTERM) 16:42:33.991756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25725): Terminating (SIGTERM) 16:42:34.031808 run iperf3-srv_10.42.42.10(pid=25726): Terminating (SIGTERM) 16:42:34.071706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25727): Terminating (SIGTERM) 16:42:34.112004 run iperf3-srv_10.42.42.10(pid=25728): Terminating (SIGTERM) 16:42:34.152028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25729): Terminating (SIGTERM) 16:42:34.192220 run iperf3-srv_10.42.42.10(pid=25730): Terminating (SIGTERM) 16:42:34.232323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25733): Terminating (SIGTERM) 16:42:34.272543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25736): Terminating (SIGTERM) 16:42:34.312658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25739): Terminating (SIGTERM) 16:42:34.353115 --- ParallelTerminationStrategy: PID 25723 died... 16:42:34.372064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25723): Terminated: ok {rc=0} 16:42:34.417171 --- ParallelTerminationStrategy: PID 25724 died... 16:42:34.435999 run iperf3-srv_10.42.42.10(pid=25724): Terminated {rc=256} 16:42:34.480431 --- ParallelTerminationStrategy: PID 25725 died... 16:42:34.499184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25725): Terminated: ok {rc=0} 16:42:34.544017 --- ParallelTerminationStrategy: PID 25726 died... 16:42:34.562859 run iperf3-srv_10.42.42.10(pid=25726): Terminated {rc=256} 16:42:34.607080 --- ParallelTerminationStrategy: PID 25727 died... 16:42:34.626010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25727): Terminated: ok {rc=0} 16:42:34.670791 --- ParallelTerminationStrategy: PID 25728 died... 16:42:34.689514 run iperf3-srv_10.42.42.10(pid=25728): Terminated {rc=256} 16:42:34.733605 --- ParallelTerminationStrategy: PID 25729 died... 16:42:34.752491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25729): Terminated: ok {rc=0} 16:42:34.796793 --- ParallelTerminationStrategy: PID 25730 died... 16:42:34.816244 run iperf3-srv_10.42.42.10(pid=25730): Terminated {rc=256} 16:42:34.860204 --- ParallelTerminationStrategy: PID 25733 died... 16:42:34.878774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25733): Terminated: ok {rc=0} 16:42:34.922768 --- ParallelTerminationStrategy: PID 25736 died... 16:42:34.941359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25736): Terminated: ok {rc=0} 16:42:34.985901 --- ParallelTerminationStrategy: PID 25739 died... 16:42:35.004637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25739): Terminated: ok {rc=0} 16:42:35.089194 bus /gobi_4: Setting Powered False 16:42:36.187803 bus /gobi_4: Setting Powered False 16:42:37.306062 bus /gobi_1: Setting Powered False 16:42:38.405654 bus /gobi_1: Setting Powered False 16:42:39.519825 bus /gobi_0: Setting Powered False 16:42:40.616172 bus /gobi_0: Setting Powered False 16:42:41.732384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:42:42.836274 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:42.847787 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:42:42.908159 tst ping.py: using LAC 29279 16:42:43.024381 tst ping.py: using RAC 209 16:42:43.138459 tst ping.py: using CellId 29279 16:42:43.254182 tst ping.py: using BVCI 29280 16:42:43.359869 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:43.370929 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:43.381751 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:43.392738 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:43.403789 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:43.414862 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:43.426072 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:43.437128 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:43.550622 tst ping.py:19: start network... 16:42:43.761864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:44.245115 run create_hlr_db(pid=25741): Launched 16:42:44.372545 bus /gobi_6: Setting Powered False 16:42:45.434922 run create_hlr_db(pid=25741): Terminated: ok {rc=0} 16:42:45.857763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25743): Launched 16:42:46.190596 run osmo-hlr_10.42.42.2(pid=25744): Launched 16:42:46.381715 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:46.980883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25746): Launched 16:42:47.289808 run osmo-stp_10.42.42.5(pid=25747): Launched 16:42:47.462676 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:48.002601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25749): Launched 16:42:48.113868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:48.360219 run patchelf(pid=25750): Launched 16:42:48.522693 run osmo-stp_10.42.42.5(pid=25747): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25747)] 16:42:48.646713 run osmo-stp_10.42.42.5(pid=25747): stdout: | (launched: 2022-12-10_16:42:47.226583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:48.772179 run osmo-stp_10.42.42.5(pid=25747): stderr: | [0;m[38;5;43m20221210164247498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164247498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164247498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164247498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164247499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164247499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164247499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:48.897623 run osmo-stp_10.42.42.5(pid=25747): stdout: | (launched: 2022-12-10_16:42:47.226583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:49.017495 run osmo-stp_10.42.42.5(pid=25747): stderr: | [0;m[38;5;43m20221210164247498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164247498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164247498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164247498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164247499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164247499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164247499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:49.159314 run patchelf(pid=25750): Terminating (SIGINT) 16:42:49.323573 run patchelf(pid=25750): Terminated: ok {rc=0} 16:42:49.442267 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25747): Process ended prematurely: osmo-stp_10.42.42.5(pid=25747) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25747)] [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 16:42:49.450985 tst ping.py:22: Test FAILED (6.6 sec) 16:42:49.478088 run osmo-hlr_10.42.42.2(pid=25744): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25744)] 16:42:49.525756 run osmo-hlr_10.42.42.2(pid=25744): stdout: | (launched: 2022-12-10_16:42:46.122398) 16:42:49.575242 run osmo-hlr_10.42.42.2(pid=25744): stderr: | [0;m[1;31m20221210164246517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164246517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164246518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164246518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164246518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164246518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164246541 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164246549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164246549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164246549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:49.624864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25743): Terminating (SIGTERM) 16:42:49.664581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25746): Terminating (SIGTERM) 16:42:49.704373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25749): Terminating (SIGTERM) 16:42:49.744328 --- ParallelTerminationStrategy: PID 25743 died... 16:42:49.763406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25743): Terminated: ok {rc=0} 16:42:49.807775 --- ParallelTerminationStrategy: PID 25746 died... 16:42:49.826272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25746): Terminated: ok {rc=0} 16:42:49.870357 --- ParallelTerminationStrategy: PID 25749 died... 16:42:49.888869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25749): Terminated: ok {rc=0} 16:42:49.973183 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:42:51.057409 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:51.068790 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:42:51.131829 tst ping_idle_ping.py: using LAC 29280 16:42:51.245730 tst ping_idle_ping.py: using RAC 210 16:42:51.361067 tst ping_idle_ping.py: using CellId 29280 16:42:51.474251 tst ping_idle_ping.py: using BVCI 29281 16:42:51.580253 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:51.591300 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:51.602258 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:51.613241 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:51.624068 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:51.635070 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:51.646261 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:51.657229 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:51.773064 tst ping_idle_ping.py:24: start network... 16:42:51.986425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:52.472799 run create_hlr_db(pid=25751): Launched 16:42:52.599675 bus /gobi_6: Setting Powered False 16:42:53.661670 run create_hlr_db(pid=25751): Terminated: ok {rc=0} 16:42:54.081122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25753): Launched 16:42:54.374270 run osmo-hlr_10.42.42.2(pid=25754): Launched 16:42:54.485687 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:54.990204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25756): Launched 16:42:55.282358 run osmo-stp_10.42.42.5(pid=25757): Launched 16:42:55.393655 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:55.898236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25759): Launched 16:42:56.009986 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:56.256561 run patchelf(pid=25760): Launched 16:42:56.419377 run osmo-stp_10.42.42.5(pid=25757): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25757)] 16:42:56.543214 run osmo-stp_10.42.42.5(pid=25757): stdout: | (launched: 2022-12-10_16:42:55.228517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:56.668858 run osmo-stp_10.42.42.5(pid=25757): stderr: | [0;m[38;5;43m20221210164255396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164255396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164255396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164255397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164255399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164255399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164255399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:56.794403 run osmo-stp_10.42.42.5(pid=25757): stdout: | (launched: 2022-12-10_16:42:55.228517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:56.914380 run osmo-stp_10.42.42.5(pid=25757): stderr: | [0;m[38;5;43m20221210164255396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164255396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164255396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164255397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164255399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164255399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164255399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:57.056656 run patchelf(pid=25760): Terminating (SIGINT) 16:42:57.221296 run patchelf(pid=25760): Terminated: ok {rc=0} 16:42:57.339856 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25757): Process ended prematurely: osmo-stp_10.42.42.5(pid=25757) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25757)] [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:42:57.349022 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 16:42:57.375903 run osmo-hlr_10.42.42.2(pid=25754): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25754)] 16:42:57.423590 run osmo-hlr_10.42.42.2(pid=25754): stdout: | (launched: 2022-12-10_16:42:54.320100) 16:42:57.472796 run osmo-hlr_10.42.42.2(pid=25754): stderr: | [0;m[1;31m20221210164254494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164254494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164254494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164254494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164254494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164254494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164254507 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164254517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164254517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164254517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:57.522449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25753): Terminating (SIGTERM) 16:42:57.562373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25756): Terminating (SIGTERM) 16:42:57.602347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25759): Terminating (SIGTERM) 16:42:57.642371 --- ParallelTerminationStrategy: PID 25753 died... 16:42:57.661573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25753): Terminated: ok {rc=0} 16:42:57.706651 --- ParallelTerminationStrategy: PID 25756 died... 16:42:57.725408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25756): Terminated: ok {rc=0} 16:42:57.769786 --- ParallelTerminationStrategy: PID 25759 died... 16:42:57.788376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25759): Terminated: ok {rc=0} 16:42:57.871231 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 16:42:59.172146 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:42:59.181665 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:42:59.206074 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:42:59.240445 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:42:59.292040 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:42:59.317952 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:42:59.354318 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:42:59.919008 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:42:59.925453 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:42:59.938279 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:43:00.000366 tst switch_tch_pdch.py: using LAC 29281 16:43:00.123147 tst switch_tch_pdch.py: using RAC 211 16:43:00.243882 tst switch_tch_pdch.py: using CellId 29281 16:43:00.365033 tst switch_tch_pdch.py: using BVCI 29282 16:43:00.478282 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:00.490331 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:00.502275 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:00.514123 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:00.526026 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:00.537876 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:00.550258 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:00.562324 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:43:00.677176 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:43:00.795176 tst switch_tch_pdch.py:51: start network... 16:43:01.030492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:01.529648 run create_hlr_db(pid=25764): Launched 16:43:01.680437 bus /gobi_6: Setting Powered False 16:43:02.742886 run create_hlr_db(pid=25764): Terminated: ok {rc=0} 16:43:03.162247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25766): Launched 16:43:03.454071 run osmo-hlr_10.42.42.2(pid=25767): Launched 16:43:03.566403 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:04.083010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25769): Launched 16:43:04.373989 run osmo-stp_10.42.42.5(pid=25770): Launched 16:43:04.484732 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:43:04.987038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25772): Launched 16:43:05.098391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:43:05.343582 run patchelf(pid=25773): Launched 16:43:05.505230 run osmo-stp_10.42.42.5(pid=25770): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25770)] 16:43:05.628908 run osmo-stp_10.42.42.5(pid=25770): stdout: | (launched: 2022-12-10_16:43:04.320245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:05.753990 run osmo-stp_10.42.42.5(pid=25770): stderr: | [0;m[38;5;43m20221210164304492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164304493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164304493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164304493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164304494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164304494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164304494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:05.878795 run osmo-stp_10.42.42.5(pid=25770): stdout: | (launched: 2022-12-10_16:43:04.320245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:05.998307 run osmo-stp_10.42.42.5(pid=25770): stderr: | [0;m[38;5;43m20221210164304492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164304493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164304493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164304493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164304494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164304494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164304494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:06.139940 run patchelf(pid=25773): Terminating (SIGINT) 16:43:06.303737 run patchelf(pid=25773): Terminated: ok {rc=0} 16:43:06.421990 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25770): Process ended prematurely: osmo-stp_10.42.42.5(pid=25770) [trial-2376↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25770)] [trial-2376↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:43:06.430831 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:43:06.458087 run osmo-hlr_10.42.42.2(pid=25767): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25767)] 16:43:06.505626 run osmo-hlr_10.42.42.2(pid=25767): stdout: | (launched: 2022-12-10_16:43:03.400061) 16:43:06.554651 run osmo-hlr_10.42.42.2(pid=25767): stderr: | [0;m[1;31m20221210164303575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164303575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164303575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164303575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164303575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164303575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164303589 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164303597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164303597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164303598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:06.604077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25766): Terminating (SIGTERM) 16:43:06.643707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25769): Terminating (SIGTERM) 16:43:06.683240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25772): Terminating (SIGTERM) 16:43:06.723166 --- ParallelTerminationStrategy: PID 25766 died... 16:43:06.742071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25766): Terminated: ok {rc=0} 16:43:06.786207 --- ParallelTerminationStrategy: PID 25769 died... 16:43:06.804559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25769): Terminated: ok {rc=0} 16:43:06.848486 --- ParallelTerminationStrategy: PID 25772 died... 16:43:06.867039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25772): Terminated: ok {rc=0} 16:43:06.952713 bus /gobi_0: Setting Powered False 16:43:08.050819 bus /gobi_0: Setting Powered False 16:43:09.163576 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 sms:nanobts+band-900 --------------------------------------------------------------------- 16:43:10.405254 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:10.409973 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:43:10.442690 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 16:43:10.469174 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 16:43:10.521297 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:43:10.552853 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 16:43:10.578821 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 16:43:11.125431 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 16:43:11.130384 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:11.141102 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 16:43:11.186414 tst mo_mt_sms.py: using LAC 29282 16:43:11.302142 tst mo_mt_sms.py: using RAC 212 16:43:11.417292 tst mo_mt_sms.py: using CellId 29282 16:43:11.532901 tst mo_mt_sms.py: using BVCI 29283 16:43:11.647709 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:11.658949 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:11.670038 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:11.681211 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:11.692153 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:11.703242 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 16:43:11.817990 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 16:43:11.930933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:12.383463 run create_hlr_db(pid=25778): Launched 16:43:12.496028 bus /gobi_6: Setting Powered False 16:43:13.555523 run create_hlr_db(pid=25778): Terminated: ok {rc=0} 16:43:13.964460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25780): Launched 16:43:14.256174 run osmo-hlr_10.42.42.2(pid=25781): Launched 16:43:14.367650 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:14.885652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25783): Launched 16:43:15.177398 run osmo-stp_10.42.42.5(pid=25784): Launched 16:43:15.288714 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:15.818697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25786): Launched 16:43:16.149504 run osmo-msc_10.42.42.6(pid=25787): Launched 16:43:16.583945 run osmo-stp_10.42.42.5(pid=25784): ERR: Terminated: ERROR {rc=1} [trial-2376↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25784)] 16:43:16.845251 run osmo-stp_10.42.42.5(pid=25784): stdout: | (launched: 2022-12-10_16:43:15.123266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:16.979172 run osmo-stp_10.42.42.5(pid=25784): stderr: | [0;m[38;5;43m20221210164315295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164315295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164315295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164315296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164315296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164315296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164315296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:17.113872 run osmo-stp_10.42.42.5(pid=25784): stdout: | (launched: 2022-12-10_16:43:15.123266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:17.242801 run osmo-stp_10.42.42.5(pid=25784): stderr: | [0;m[38;5;43m20221210164315295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164315295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164315295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164315296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164315296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164315296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164315296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:17.394171 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25784): Process ended prematurely: osmo-stp_10.42.42.5(pid=25784) [trial-2376↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25784)] [trial-2376↪sms:nanobts+band-900↪mo_mt_sms.py:16] 16:43:17.402925 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 16:43:17.431348 run osmo-hlr_10.42.42.2(pid=25781): ERR: Terminated: ERROR {rc=237} [trial-2376↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25781)] 16:43:17.481556 run osmo-hlr_10.42.42.2(pid=25781): stdout: | (launched: 2022-12-10_16:43:14.202395) 16:43:17.533308 run osmo-hlr_10.42.42.2(pid=25781): stderr: | [0;m[1;31m20221210164314377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164314377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164314377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164314377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164314377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164314377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164314390 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164314400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164314400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164314400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:17.606340 run osmo-msc_10.42.42.6(pid=25787): ERR: Terminated: ERROR {rc=2} [trial-2376↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25787)] 16:43:17.656104 run osmo-msc_10.42.42.6(pid=25787): stdout: | (launched: 2022-12-10_16:43:16.076744) 16:43:17.707607 run osmo-msc_10.42.42.6(pid=25787): stderr: | [0;m[38;5;43m20221210164316471 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164316471 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5d1dc82c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164316471 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164316471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164316472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164316472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164316474 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164316474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164316475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164316475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:17.759424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25780): Terminating (SIGTERM) 16:43:17.801135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25783): Terminating (SIGTERM) 16:43:17.843063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25786): Terminating (SIGTERM) 16:43:17.885245 --- ParallelTerminationStrategy: PID 25780 died... 16:43:17.905414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25780): Terminated: ok {rc=0} 16:43:17.951782 --- ParallelTerminationStrategy: PID 25783 died... 16:43:17.971485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25783): Terminated: ok {rc=0} 16:43:18.017785 --- ParallelTerminationStrategy: PID 25786 died... 16:43:18.037491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25786): Terminated: ok {rc=0} 16:43:18.126111 bus /sierra_3: Setting Powered False 16:43:19.223286 bus /sierra_3: Setting Powered False 16:43:20.339495 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 16:43:21.576197 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:21.581117 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:43:21.613998 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 16:43:21.620942 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 16:43:21.657739 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:43:21.690871 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 16:43:21.697960 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 16:43:22.214850 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2376 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 16:43:22.220451 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 16:43:22.231355 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 16:43:22.276497 tst assert_extension.py: using LAC 29283 16:43:22.390511 tst assert_extension.py: using RAC 213 16:43:22.504723 tst assert_extension.py: using CellId 29283 16:43:22.622736 tst assert_extension.py: using BVCI 29284 16:43:22.730067 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 16:43:22.846504 tst assert_extension.py:10: start nitb and bts... 16:43:23.058096 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:43:23.697656 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25793): Launched 16:43:24.011062 run osmo-nitb_10.42.42.2(pid=25794): Launched 16:43:24.183836 run osmo-nitb_10.42.42.2(pid=25794): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25794)] 16:43:24.323767 run osmo-nitb_10.42.42.2(pid=25794): stdout: | (launched: 2022-12-10_16:43:23.953309) 16:43:24.465839 run osmo-nitb_10.42.42.2(pid=25794): stderr: | (launched: 2022-12-10_16:43:23.999950) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:43:24.608631 run osmo-nitb_10.42.42.2(pid=25794): stdout: | (launched: 2022-12-10_16:43:23.953309) 16:43:24.745032 run osmo-nitb_10.42.42.2(pid=25794): stderr: | (launched: 2022-12-10_16:43:23.999950) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25794): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25794) [trial-2376↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25794)] 16:43:25.129218 tst osmo-nitb_10.42.42.2(pid=25794): stdout: | (launched: 2022-12-10_16:43:23.953309) 16:43:25.255842 tst osmo-nitb_10.42.42.2(pid=25794): stderr: | (launched: 2022-12-10_16:43:23.999950) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:43:25.405341 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25794): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25794) [trial-2376↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25794)] [trial-2376↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 16:43:25.414163 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:43:25.421148 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25793): Terminating (SIGTERM) 16:43:25.631953 --- ParallelTerminationStrategy: PID 25793 died... 16:43:25.653576 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25793): Terminated: ok {rc=0} 16:43:25.741890 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 ussd:nanobts+band-900 --------------------------------------------------------------------- 16:43:26.913851 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:26.919437 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:43:26.952123 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 16:43:26.979364 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 16:43:27.014894 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:43:27.047745 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 16:43:27.074974 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 16:43:27.605113 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 16:43:27.610284 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:27.621494 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 16:43:27.668376 tst assert_extension.py: using LAC 29284 16:43:27.793215 tst assert_extension.py: using RAC 214 16:43:27.914660 tst assert_extension.py: using CellId 29284 16:43:28.036516 tst assert_extension.py: using BVCI 29285 16:43:28.149386 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:28.160413 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:28.171484 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:28.182403 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:28.193425 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:28.204269 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 16:43:28.315910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:28.769113 run create_hlr_db(pid=25799): Launched 16:43:28.881481 bus /sierra_2: Setting Powered False 16:43:29.941284 run create_hlr_db(pid=25799): Terminated: ok {rc=0} 16:43:30.371065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25801): Launched 16:43:30.685947 run osmo-hlr_10.42.42.2(pid=25802): Launched 16:43:30.805071 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:31.469685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25804): Launched 16:43:31.785309 run osmo-stp_10.42.42.5(pid=25805): Launched 16:43:32.018207 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:32.738080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25807): Launched 16:43:33.049677 run osmo-msc_10.42.42.6(pid=25808): Launched 16:43:33.223452 run osmo-stp_10.42.42.5(pid=25805): ERR: Terminated: ERROR {rc=1} [trial-2376↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25805)] 16:43:33.355410 run osmo-stp_10.42.42.5(pid=25805): stdout: | (launched: 2022-12-10_16:43:31.723280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:33.487730 run osmo-stp_10.42.42.5(pid=25805): stderr: | [0;m[38;5;43m20221210164332059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164332059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164332059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164332064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164332064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164332064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164332064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:33.620174 run osmo-stp_10.42.42.5(pid=25805): stdout: | (launched: 2022-12-10_16:43:31.723280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:33.745127 run osmo-stp_10.42.42.5(pid=25805): stderr: | [0;m[38;5;43m20221210164332059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164332059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164332059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164332064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164332064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164332064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164332064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:33.894738 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25805): Process ended prematurely: osmo-stp_10.42.42.5(pid=25805) [trial-2376↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25805)] [trial-2376↪ussd:nanobts+band-900↪assert_extension.py:17] 16:43:33.903497 tst assert_extension.py:17: Test FAILED (6.3 sec) 16:43:33.930983 run osmo-hlr_10.42.42.2(pid=25802): ERR: Terminated: ERROR {rc=237} [trial-2376↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25802)] 16:43:33.981153 run osmo-hlr_10.42.42.2(pid=25802): stdout: | (launched: 2022-12-10_16:43:30.628312) 16:43:34.033141 run osmo-hlr_10.42.42.2(pid=25802): stderr: | [0;m[1;31m20221210164330827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164330827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164330827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164330827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164330827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164330827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164330851 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164330872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164330872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164330872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:34.105689 run osmo-msc_10.42.42.6(pid=25808): ERR: Terminated: ERROR {rc=2} [trial-2376↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25808)] 16:43:34.155758 run osmo-msc_10.42.42.6(pid=25808): stdout: | (launched: 2022-12-10_16:43:32.992483) 16:43:34.207635 run osmo-msc_10.42.42.6(pid=25808): stderr: | [0;m[38;5;43m20221210164333311 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164333311 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f146595cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164333311 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164333311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164333312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164333312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164333314 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164333314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164333314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164333314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:34.260206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25801): Terminating (SIGTERM) 16:43:34.302207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25804): Terminating (SIGTERM) 16:43:34.344383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25807): Terminating (SIGTERM) 16:43:34.386873 --- ParallelTerminationStrategy: PID 25801 died... 16:43:34.407032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25801): Terminated: ok {rc=0} 16:43:34.453749 --- ParallelTerminationStrategy: PID 25804 died... 16:43:34.473450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25804): Terminated: ok {rc=0} 16:43:34.519773 --- ParallelTerminationStrategy: PID 25807 died... 16:43:34.539380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25807): Terminated: ok {rc=0} 16:43:34.627190 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:43:35.835238 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:35.842769 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:43:35.875455 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:43:35.901896 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:43:35.953983 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:43:35.986375 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:43:36.012603 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:43:36.564375 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:43:36.613819 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:36.625121 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:43:36.690252 tst mo_mt_call.py: using LAC 29285 16:43:36.808884 tst mo_mt_call.py: using RAC 215 16:43:36.925297 tst mo_mt_call.py: using CellId 29285 16:43:37.041579 tst mo_mt_call.py: using BVCI 29286 16:43:37.149857 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:37.161009 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:37.172002 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:37.183247 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:37.194647 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:37.206125 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:43:37.323583 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:43:37.442514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:37.935698 run create_hlr_db(pid=25813): Launched 16:43:38.064151 bus /sierra_2: Setting Powered False 16:43:39.128484 run create_hlr_db(pid=25813): Terminated: ok {rc=0} 16:43:39.553317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25815): Launched 16:43:39.851255 run osmo-hlr_10.42.42.2(pid=25816): Launched 16:43:39.964420 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:40.490623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25818): Launched 16:43:40.787901 run osmo-stp_10.42.42.5(pid=25819): Launched 16:43:40.900540 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:41.437290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25821): Launched 16:43:41.735443 run osmo-msc_10.42.42.6(pid=25822): Launched 16:43:41.902251 run osmo-stp_10.42.42.5(pid=25819): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25819)] 16:43:42.028364 run osmo-stp_10.42.42.5(pid=25819): stdout: | (launched: 2022-12-10_16:43:40.733402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:42.155183 run osmo-stp_10.42.42.5(pid=25819): stderr: | [0;m[38;5;43m20221210164340904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164340905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164340905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164340905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164340907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164340908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164340908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:42.279439 run osmo-stp_10.42.42.5(pid=25819): stdout: | (launched: 2022-12-10_16:43:40.733402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:42.397965 run osmo-stp_10.42.42.5(pid=25819): stderr: | [0;m[38;5;43m20221210164340904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164340905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164340905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164340905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164340907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164340908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164340908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:42.539764 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25819): Process ended prematurely: osmo-stp_10.42.42.5(pid=25819) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25819)] [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:43:42.548656 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:43:42.575710 run osmo-hlr_10.42.42.2(pid=25816): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25816)] 16:43:42.623540 run osmo-hlr_10.42.42.2(pid=25816): stdout: | (launched: 2022-12-10_16:43:39.796572) 16:43:42.673392 run osmo-hlr_10.42.42.2(pid=25816): stderr: | [0;m[1;31m20221210164339975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164339975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164339975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164339975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164339975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164339975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164339990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164339998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164339998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164339998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:42.743010 run osmo-msc_10.42.42.6(pid=25822): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25822)] 16:43:42.791337 run osmo-msc_10.42.42.6(pid=25822): stdout: | (launched: 2022-12-10_16:43:41.680935) 16:43:42.840844 run osmo-msc_10.42.42.6(pid=25822): stderr: | [0;m[38;5;43m20221210164341951 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164341951 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa6b3a6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164341951 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164341951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164341951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164341951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164341953 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164341954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164341954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164341954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:42.890630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25815): Terminating (SIGTERM) 16:43:42.930508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25818): Terminating (SIGTERM) 16:43:42.970385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25821): Terminating (SIGTERM) 16:43:43.010547 --- ParallelTerminationStrategy: PID 25815 died... 16:43:43.029762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25815): Terminated: ok {rc=0} 16:43:43.074314 --- ParallelTerminationStrategy: PID 25818 died... 16:43:43.092894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25818): Terminated: ok {rc=0} 16:43:43.137245 --- ParallelTerminationStrategy: PID 25821 died... 16:43:43.155662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25821): Terminated: ok {rc=0} 16:43:43.238732 bus /sierra_3: Setting Powered False 16:43:44.337701 bus /sierra_3: Setting Powered False 16:43:45.453715 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:43:46.619330 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:46.635389 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:43:46.720897 tst mo_mt_call_osmux.py: using LAC 29286 16:43:46.839848 tst mo_mt_call_osmux.py: using RAC 216 16:43:46.991458 tst mo_mt_call_osmux.py: using CellId 29286 16:43:47.135630 tst mo_mt_call_osmux.py: using BVCI 29287 16:43:47.247650 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:47.259827 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:47.271788 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:47.285902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:47.298316 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:47.309706 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:43:47.427263 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:43:47.547853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:48.012183 run create_hlr_db(pid=25824): Launched 16:43:48.126076 bus /sierra_2: Setting Powered False 16:43:49.186283 run create_hlr_db(pid=25824): Terminated: ok {rc=0} 16:43:49.602956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25826): Launched 16:43:49.901647 run osmo-hlr_10.42.42.2(pid=25827): Launched 16:43:50.015360 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:50.541394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25829): Launched 16:43:50.841666 run osmo-stp_10.42.42.5(pid=25830): Launched 16:43:50.955765 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:51.495841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25832): Launched 16:43:51.793980 run osmo-msc_10.42.42.6(pid=25833): Launched 16:43:51.960152 run osmo-stp_10.42.42.5(pid=25830): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25830)] 16:43:52.087140 run osmo-stp_10.42.42.5(pid=25830): stdout: | (launched: 2022-12-10_16:43:50.785824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:52.214419 run osmo-stp_10.42.42.5(pid=25830): stderr: | [0;m[38;5;43m20221210164350956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164350956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164350956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164350957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164350957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164350957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164350957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:52.340048 run osmo-stp_10.42.42.5(pid=25830): stdout: | (launched: 2022-12-10_16:43:50.785824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:52.459287 run osmo-stp_10.42.42.5(pid=25830): stderr: | [0;m[38;5;43m20221210164350956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164350956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164350956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164350957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164350957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164350957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164350957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:52.602172 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25830): Process ended prematurely: osmo-stp_10.42.42.5(pid=25830) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25830)] [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:43:52.610903 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:43:52.638668 run osmo-hlr_10.42.42.2(pid=25827): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25827)] 16:43:52.687128 run osmo-hlr_10.42.42.2(pid=25827): stdout: | (launched: 2022-12-10_16:43:49.846058) 16:43:52.736900 run osmo-hlr_10.42.42.2(pid=25827): stderr: | [0;m[1;31m20221210164350024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164350024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164350024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164350024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164350024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164350024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164350037 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164350045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164350045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164350045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:52.806309 run osmo-msc_10.42.42.6(pid=25833): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25833)] 16:43:52.854951 run osmo-msc_10.42.42.6(pid=25833): stdout: | (launched: 2022-12-10_16:43:51.739293) 16:43:52.904597 run osmo-msc_10.42.42.6(pid=25833): stderr: | [0;m[38;5;43m20221210164352010 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164352010 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe4105bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164352010 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164352010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164352010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164352010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164352012 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164352012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164352013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164352013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:52.954729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25826): Terminating (SIGTERM) 16:43:52.995293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25829): Terminating (SIGTERM) 16:43:53.035774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25832): Terminating (SIGTERM) 16:43:53.076662 --- ParallelTerminationStrategy: PID 25826 died... 16:43:53.095904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25826): Terminated: ok {rc=0} 16:43:53.141559 --- ParallelTerminationStrategy: PID 25829 died... 16:43:53.160046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25829): Terminated: ok {rc=0} 16:43:53.205739 --- ParallelTerminationStrategy: PID 25832 died... 16:43:53.224436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25832): Terminated: ok {rc=0} 16:43:53.311775 bus /sierra_3: Setting Powered False 16:43:54.411721 bus /sierra_3: Setting Powered False 16:43:55.525471 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:43:56.779337 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:56.786549 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:43:56.819693 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:43:56.846271 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:43:56.899110 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:43:56.931204 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:43:56.957252 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:43:57.506904 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:43:57.559752 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:57.571473 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:43:57.640377 tst mo_mt_call.py: using LAC 29287 16:43:57.764473 tst mo_mt_call.py: using RAC 217 16:43:57.893056 tst mo_mt_call.py: using CellId 29287 16:43:58.016547 tst mo_mt_call.py: using BVCI 29288 16:43:58.131126 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:58.142888 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:58.154365 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:58.165859 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:58.177355 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:58.188651 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:43:58.302004 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:43:58.419588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:58.882808 run create_hlr_db(pid=25839): Launched 16:43:58.996520 bus /sierra_2: Setting Powered False 16:44:00.056839 run create_hlr_db(pid=25839): Terminated: ok {rc=0} 16:44:00.474393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25841): Launched 16:44:00.771270 run osmo-hlr_10.42.42.2(pid=25842): Launched 16:44:00.921561 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:01.609947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25844): Launched 16:44:01.927176 run osmo-stp_10.42.42.5(pid=25845): Launched 16:44:02.221486 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:02.877188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25847): Launched 16:44:03.195124 run osmo-msc_10.42.42.6(pid=25848): Launched 16:44:03.371558 run osmo-stp_10.42.42.5(pid=25845): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25845)] 16:44:03.504833 run osmo-stp_10.42.42.5(pid=25845): stdout: | (launched: 2022-12-10_16:44:01.866234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:03.639292 run osmo-stp_10.42.42.5(pid=25845): stderr: | [0;m[38;5;43m20221210164402169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164402169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164402169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164402169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164402170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164402170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164402170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:03.773261 run osmo-stp_10.42.42.5(pid=25845): stdout: | (launched: 2022-12-10_16:44:01.866234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:03.899619 run osmo-stp_10.42.42.5(pid=25845): stderr: | [0;m[38;5;43m20221210164402169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164402169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164402169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164402169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164402170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164402170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164402170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:04.050904 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25845): Process ended prematurely: osmo-stp_10.42.42.5(pid=25845) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25845)] [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:44:04.060213 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:44:04.087854 run osmo-hlr_10.42.42.2(pid=25842): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25842)] 16:44:04.137427 run osmo-hlr_10.42.42.2(pid=25842): stdout: | (launched: 2022-12-10_16:44:00.716890) 16:44:04.188695 run osmo-hlr_10.42.42.2(pid=25842): stderr: | [0;m[1;31m20221210164400954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164400954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164400954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164400954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164400954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164400954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164400971 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164400994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164400994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164400994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:04.260691 run osmo-msc_10.42.42.6(pid=25848): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25848)] 16:44:04.310581 run osmo-msc_10.42.42.6(pid=25848): stdout: | (launched: 2022-12-10_16:44:03.137271) 16:44:04.361716 run osmo-msc_10.42.42.6(pid=25848): stderr: | [0;m[38;5;43m20221210164403458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164403458 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61edc42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164403459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164403459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164403459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164403459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164403461 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164403461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164403461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164403461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:04.413348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25841): Terminating (SIGTERM) 16:44:04.454862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25844): Terminating (SIGTERM) 16:44:04.496386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25847): Terminating (SIGTERM) 16:44:04.538685 --- ParallelTerminationStrategy: PID 25841 died... 16:44:04.558698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25841): Terminated: ok {rc=0} 16:44:04.605351 --- ParallelTerminationStrategy: PID 25844 died... 16:44:04.625306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25844): Terminated: ok {rc=0} 16:44:04.671221 --- ParallelTerminationStrategy: PID 25847 died... 16:44:04.690676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25847): Terminated: ok {rc=0} 16:44:04.777503 bus /sierra_3: Setting Powered False 16:44:05.877156 bus /sierra_3: Setting Powered False 16:44:06.992207 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:44:08.135319 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:08.147011 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:44:08.216369 tst mo_mt_call_osmux.py: using LAC 29288 16:44:08.333847 tst mo_mt_call_osmux.py: using RAC 218 16:44:08.449870 tst mo_mt_call_osmux.py: using CellId 29288 16:44:08.565894 tst mo_mt_call_osmux.py: using BVCI 29289 16:44:08.675841 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:08.686963 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:08.698028 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:08.709203 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:08.720403 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:08.731589 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:44:08.845342 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:44:08.963504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:09.457107 run create_hlr_db(pid=25850): Launched 16:44:09.587448 bus /sierra_2: Setting Powered False 16:44:10.651602 run create_hlr_db(pid=25850): Terminated: ok {rc=0} 16:44:11.095945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25852): Launched 16:44:11.414036 run osmo-hlr_10.42.42.2(pid=25853): Launched 16:44:11.533958 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:12.080738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25855): Launched 16:44:12.398012 run osmo-stp_10.42.42.5(pid=25856): Launched 16:44:12.518601 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:13.093771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25858): Launched 16:44:13.413253 run osmo-msc_10.42.42.6(pid=25859): Launched 16:44:13.590034 run osmo-stp_10.42.42.5(pid=25856): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25856)] 16:44:13.723276 run osmo-stp_10.42.42.5(pid=25856): stdout: | (launched: 2022-12-10_16:44:12.340376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:13.857420 run osmo-stp_10.42.42.5(pid=25856): stderr: | [0;m[38;5;43m20221210164412532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164412532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164412532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164412533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164412533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164412533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164412533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:13.990936 run osmo-stp_10.42.42.5(pid=25856): stdout: | (launched: 2022-12-10_16:44:12.340376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:14.118009 run osmo-stp_10.42.42.5(pid=25856): stderr: | [0;m[38;5;43m20221210164412532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164412532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164412532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164412533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164412533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164412533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164412533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:14.269607 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25856): Process ended prematurely: osmo-stp_10.42.42.5(pid=25856) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25856)] [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:44:14.279103 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:44:14.306837 run osmo-hlr_10.42.42.2(pid=25853): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25853)] 16:44:14.356731 run osmo-hlr_10.42.42.2(pid=25853): stdout: | (launched: 2022-12-10_16:44:11.355786) 16:44:14.408222 run osmo-hlr_10.42.42.2(pid=25853): stderr: | [0;m[1;31m20221210164411554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164411554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164411555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164411555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164411555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164411555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164411568 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164411576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164411576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164411576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:14.480407 run osmo-msc_10.42.42.6(pid=25859): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25859)] 16:44:14.530352 run osmo-msc_10.42.42.6(pid=25859): stdout: | (launched: 2022-12-10_16:44:13.354223) 16:44:14.581970 run osmo-msc_10.42.42.6(pid=25859): stderr: | [0;m[38;5;43m20221210164413677 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164413677 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4872327c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164413678 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164413678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164413678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164413678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164413680 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164413680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164413680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164413680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:14.633948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25852): Terminating (SIGTERM) 16:44:14.675661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25855): Terminating (SIGTERM) 16:44:14.717278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25858): Terminating (SIGTERM) 16:44:14.759091 --- ParallelTerminationStrategy: PID 25852 died... 16:44:14.779356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25852): Terminated: ok {rc=0} 16:44:14.825753 --- ParallelTerminationStrategy: PID 25855 died... 16:44:14.845245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25855): Terminated: ok {rc=0} 16:44:14.891537 --- ParallelTerminationStrategy: PID 25858 died... 16:44:14.911126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25858): Terminated: ok {rc=0} 16:44:14.999386 bus /sierra_3: Setting Powered False 16:44:16.099234 bus /sierra_3: Setting Powered False 16:44:17.221060 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:44:18.474114 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:44:18.482478 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:44:18.515613 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:44:18.542809 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:44:18.594962 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:44:18.627944 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:44:18.655281 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:44:19.207061 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:44:19.257871 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:19.269610 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:44:19.337696 tst mo_mt_call.py: using LAC 29289 16:44:19.461938 tst mo_mt_call.py: using RAC 219 16:44:19.588202 tst mo_mt_call.py: using CellId 29289 16:44:19.713020 tst mo_mt_call.py: using BVCI 29290 16:44:19.828161 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:19.839795 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:19.851229 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:19.862663 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:19.874136 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:19.885689 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:44:19.999427 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:44:20.118310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:20.613338 run create_hlr_db(pid=25864): Launched 16:44:20.742492 bus /sierra_2: Setting Powered False 16:44:21.806101 run create_hlr_db(pid=25864): Terminated: ok {rc=0} 16:44:22.233203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25866): Launched 16:44:22.531486 run osmo-hlr_10.42.42.2(pid=25867): Launched 16:44:22.645920 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:23.170295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25869): Launched 16:44:23.467344 run osmo-stp_10.42.42.5(pid=25870): Launched 16:44:23.580464 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:24.118388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25872): Launched 16:44:24.415701 run osmo-msc_10.42.42.6(pid=25873): Launched 16:44:24.583018 run osmo-stp_10.42.42.5(pid=25870): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25870)] 16:44:24.709324 run osmo-stp_10.42.42.5(pid=25870): stdout: | (launched: 2022-12-10_16:44:23.412848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:24.836449 run osmo-stp_10.42.42.5(pid=25870): stderr: | [0;m[38;5;43m20221210164423582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164423582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164423583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164423583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164423583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164423584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164423584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:24.960487 run osmo-stp_10.42.42.5(pid=25870): stdout: | (launched: 2022-12-10_16:44:23.412848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:25.079458 run osmo-stp_10.42.42.5(pid=25870): stderr: | [0;m[38;5;43m20221210164423582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164423582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164423583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164423583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164423583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164423584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164423584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:25.221898 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25870): Process ended prematurely: osmo-stp_10.42.42.5(pid=25870) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25870)] [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:44:25.230808 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:44:25.257723 run osmo-hlr_10.42.42.2(pid=25867): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25867)] 16:44:25.305876 run osmo-hlr_10.42.42.2(pid=25867): stdout: | (launched: 2022-12-10_16:44:22.476423) 16:44:25.355550 run osmo-hlr_10.42.42.2(pid=25867): stderr: | [0;m[1;31m20221210164422653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164422653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164422653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164422653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164422653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164422653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164422665 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164422676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164422676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164422676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:25.424556 run osmo-msc_10.42.42.6(pid=25873): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25873)] 16:44:25.472053 run osmo-msc_10.42.42.6(pid=25873): stdout: | (launched: 2022-12-10_16:44:24.360610) 16:44:25.521361 run osmo-msc_10.42.42.6(pid=25873): stderr: | [0;m[38;5;43m20221210164424631 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164424631 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f79978cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164424631 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164424631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164424631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164424632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164424634 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164424634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164424634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164424634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:25.571462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25866): Terminating (SIGTERM) 16:44:25.611773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25869): Terminating (SIGTERM) 16:44:25.651717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25872): Terminating (SIGTERM) 16:44:25.691908 --- ParallelTerminationStrategy: PID 25866 died... 16:44:25.711101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25866): Terminated: ok {rc=0} 16:44:25.755695 --- ParallelTerminationStrategy: PID 25869 died... 16:44:25.774401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25869): Terminated: ok {rc=0} 16:44:25.818845 --- ParallelTerminationStrategy: PID 25872 died... 16:44:25.837499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25872): Terminated: ok {rc=0} 16:44:25.923290 bus /sierra_3: Setting Powered False 16:44:27.025071 bus /sierra_3: Setting Powered False 16:44:28.140558 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:44:29.287885 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:29.300317 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:44:29.369495 tst mo_mt_call_osmux.py: using LAC 29290 16:44:29.495729 tst mo_mt_call_osmux.py: using RAC 220 16:44:29.615210 tst mo_mt_call_osmux.py: using CellId 29290 16:44:29.733106 tst mo_mt_call_osmux.py: using BVCI 29291 16:44:29.843246 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:29.854692 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:29.865838 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:29.877110 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:29.888496 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:29.899741 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:44:30.017192 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:44:30.139612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:30.602107 run create_hlr_db(pid=25875): Launched 16:44:30.715665 bus /sierra_2: Setting Powered False 16:44:31.793787 run create_hlr_db(pid=25875): Terminated: ok {rc=0} 16:44:32.273033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25877): Launched 16:44:32.592251 run osmo-hlr_10.42.42.2(pid=25878): Launched 16:44:32.714130 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:33.263155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25880): Launched 16:44:33.580662 run osmo-stp_10.42.42.5(pid=25881): Launched 16:44:33.702449 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:34.278169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25883): Launched 16:44:34.596766 run osmo-msc_10.42.42.6(pid=25884): Launched 16:44:34.774275 run osmo-stp_10.42.42.5(pid=25881): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25881)] 16:44:34.908185 run osmo-stp_10.42.42.5(pid=25881): stdout: | (launched: 2022-12-10_16:44:33.522779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:35.043088 run osmo-stp_10.42.42.5(pid=25881): stderr: | [0;m[38;5;43m20221210164433715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164433715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164433716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164433716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164433716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164433717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164433717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:35.178187 run osmo-stp_10.42.42.5(pid=25881): stdout: | (launched: 2022-12-10_16:44:33.522779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:35.306700 run osmo-stp_10.42.42.5(pid=25881): stderr: | [0;m[38;5;43m20221210164433715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164433715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164433716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164433716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164433716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164433717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164433717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:35.459036 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25881): Process ended prematurely: osmo-stp_10.42.42.5(pid=25881) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25881)] [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:44:35.468608 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:44:35.496731 run osmo-hlr_10.42.42.2(pid=25878): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25878)] 16:44:35.546873 run osmo-hlr_10.42.42.2(pid=25878): stdout: | (launched: 2022-12-10_16:44:32.534160) 16:44:35.598936 run osmo-hlr_10.42.42.2(pid=25878): stderr: | [0;m[1;31m20221210164432734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164432734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164432734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164432734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164432734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164432734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164432747 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164432757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164432757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164432757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:35.671295 run osmo-msc_10.42.42.6(pid=25884): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25884)] 16:44:35.721161 run osmo-msc_10.42.42.6(pid=25884): stdout: | (launched: 2022-12-10_16:44:34.538562) 16:44:35.772555 run osmo-msc_10.42.42.6(pid=25884): stderr: | [0;m[38;5;43m20221210164434861 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164434862 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff073e88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164434862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164434862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164434862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164434862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164434864 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164434864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164434864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164434864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:35.824115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25877): Terminating (SIGTERM) 16:44:35.866115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25880): Terminating (SIGTERM) 16:44:35.907920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25883): Terminating (SIGTERM) 16:44:35.950156 --- ParallelTerminationStrategy: PID 25877 died... 16:44:35.970215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25877): Terminated: ok {rc=0} 16:44:36.016932 --- ParallelTerminationStrategy: PID 25880 died... 16:44:36.036739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25880): Terminated: ok {rc=0} 16:44:36.083185 --- ParallelTerminationStrategy: PID 25883 died... 16:44:36.102934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25883): Terminated: ok {rc=0} 16:44:36.190002 bus /sierra_3: Setting Powered False 16:44:37.287759 bus /sierra_3: Setting Powered False 16:44:38.403153 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:44:39.653114 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:44:39.660668 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:44:39.693563 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:44:39.719757 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:44:39.770894 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:44:39.802976 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:44:39.829626 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:44:40.380373 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:44:40.433535 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:40.445478 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:44:40.521066 tst mo_mt_call.py: using LAC 29291 16:44:40.645879 tst mo_mt_call.py: using RAC 221 16:44:40.773995 tst mo_mt_call.py: using CellId 29291 16:44:40.898204 tst mo_mt_call.py: using BVCI 29292 16:44:41.015919 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:41.027813 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:41.039453 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:41.051313 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:41.063419 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:41.075281 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:44:41.194664 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:44:41.313086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:41.805217 run create_hlr_db(pid=25889): Launched 16:44:41.933618 bus /sierra_2: Setting Powered False 16:44:42.996893 run create_hlr_db(pid=25889): Terminated: ok {rc=0} 16:44:43.423930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25891): Launched 16:44:43.721534 run osmo-hlr_10.42.42.2(pid=25892): Launched 16:44:43.834685 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:44.359577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25894): Launched 16:44:44.656841 run osmo-stp_10.42.42.5(pid=25895): Launched 16:44:44.769549 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:45.307470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25897): Launched 16:44:45.605205 run osmo-msc_10.42.42.6(pid=25898): Launched 16:44:45.770810 run osmo-stp_10.42.42.5(pid=25895): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25895)] 16:44:45.981121 run osmo-stp_10.42.42.5(pid=25895): stdout: | (launched: 2022-12-10_16:44:44.602026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:46.169838 run osmo-stp_10.42.42.5(pid=25895): stderr: | [0;m[38;5;43m20221210164444771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164444771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164444771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164444771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164444772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164444772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164444772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:46.307647 run osmo-stp_10.42.42.5(pid=25895): stdout: | (launched: 2022-12-10_16:44:44.602026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:46.440263 run osmo-stp_10.42.42.5(pid=25895): stderr: | [0;m[38;5;43m20221210164444771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164444771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164444771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164444771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164444772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164444772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164444772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:46.596815 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25895): Process ended prematurely: osmo-stp_10.42.42.5(pid=25895) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25895)] [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:44:46.608507 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:44:46.637617 run osmo-hlr_10.42.42.2(pid=25892): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25892)] 16:44:46.689705 run osmo-hlr_10.42.42.2(pid=25892): stdout: | (launched: 2022-12-10_16:44:43.666842) 16:44:46.742770 run osmo-hlr_10.42.42.2(pid=25892): stderr: | [0;m[1;31m20221210164443843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164443843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164443843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164443843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164443844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164443844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164443857 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164443865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164443866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164443866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:46.817649 run osmo-msc_10.42.42.6(pid=25898): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25898)] 16:44:46.869135 run osmo-msc_10.42.42.6(pid=25898): stdout: | (launched: 2022-12-10_16:44:45.550234) 16:44:46.922928 run osmo-msc_10.42.42.6(pid=25898): stderr: | [0;m[38;5;43m20221210164445821 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164445822 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41b3f46c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164445822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164445822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164445822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164445822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164445824 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164445824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164445824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164445824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:46.975745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25891): Terminating (SIGTERM) 16:44:47.020261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25894): Terminating (SIGTERM) 16:44:47.065509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25897): Terminating (SIGTERM) 16:44:47.111133 --- ParallelTerminationStrategy: PID 25891 died... 16:44:47.131553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25891): Terminated: ok {rc=0} 16:44:47.180633 --- ParallelTerminationStrategy: PID 25894 died... 16:44:47.201848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25894): Terminated: ok {rc=0} 16:44:47.249121 --- ParallelTerminationStrategy: PID 25897 died... 16:44:47.269286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25897): Terminated: ok {rc=0} 16:44:47.357699 bus /sierra_3: Setting Powered False 16:44:48.456468 bus /sierra_3: Setting Powered False 16:44:49.569848 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:44:50.711538 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:50.723498 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:44:50.789494 tst mo_mt_call_osmux.py: using LAC 29292 16:44:50.906315 tst mo_mt_call_osmux.py: using RAC 222 16:44:51.024460 tst mo_mt_call_osmux.py: using CellId 29292 16:44:51.141442 tst mo_mt_call_osmux.py: using BVCI 29293 16:44:51.257478 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:51.269368 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:51.281261 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:51.293300 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:51.305352 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:51.317235 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:44:51.433763 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:44:51.547914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:52.010366 run create_hlr_db(pid=25900): Launched 16:44:52.123975 bus /sierra_2: Setting Powered False 16:44:53.183302 run create_hlr_db(pid=25900): Terminated: ok {rc=0} 16:44:53.619517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25902): Launched 16:44:53.938884 run osmo-hlr_10.42.42.2(pid=25903): Launched 16:44:54.059582 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:54.612914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25905): Launched 16:44:54.931648 run osmo-stp_10.42.42.5(pid=25906): Launched 16:44:55.052512 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:55.629149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25908): Launched 16:44:55.948464 run osmo-msc_10.42.42.6(pid=25909): Launched 16:44:56.126106 run osmo-stp_10.42.42.5(pid=25906): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25906)] 16:44:56.260002 run osmo-stp_10.42.42.5(pid=25906): stdout: | (launched: 2022-12-10_16:44:54.873444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:56.394841 run osmo-stp_10.42.42.5(pid=25906): stderr: | [0;m[38;5;43m20221210164455066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164455067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164455067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164455067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164455068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164455068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164455068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:56.528937 run osmo-stp_10.42.42.5(pid=25906): stdout: | (launched: 2022-12-10_16:44:54.873444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:56.656806 run osmo-stp_10.42.42.5(pid=25906): stderr: | [0;m[38;5;43m20221210164455066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164455067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164455067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164455067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164455068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164455068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164455068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:56.809607 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25906): Process ended prematurely: osmo-stp_10.42.42.5(pid=25906) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25906)] [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:44:56.819319 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:44:56.847598 run osmo-hlr_10.42.42.2(pid=25903): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25903)] 16:44:56.897507 run osmo-hlr_10.42.42.2(pid=25903): stdout: | (launched: 2022-12-10_16:44:53.880726) 16:44:56.949392 run osmo-hlr_10.42.42.2(pid=25903): stderr: | [0;m[1;31m20221210164454078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164454078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164454078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164454078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164454078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164454078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164454090 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164454099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164454099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164454099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:57.021801 run osmo-msc_10.42.42.6(pid=25909): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25909)] 16:44:57.071541 run osmo-msc_10.42.42.6(pid=25909): stdout: | (launched: 2022-12-10_16:44:55.889910) 16:44:57.122965 run osmo-msc_10.42.42.6(pid=25909): stderr: | [0;m[38;5;43m20221210164456211 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164456212 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc13c8a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164456212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164456212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164456212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164456212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164456214 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164456214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164456215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164456215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:57.174714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25902): Terminating (SIGTERM) 16:44:57.216703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25905): Terminating (SIGTERM) 16:44:57.259001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25908): Terminating (SIGTERM) 16:44:57.301373 --- ParallelTerminationStrategy: PID 25902 died... 16:44:57.321287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25902): Terminated: ok {rc=0} 16:44:57.368404 --- ParallelTerminationStrategy: PID 25905 died... 16:44:57.388158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25905): Terminated: ok {rc=0} 16:44:57.434672 --- ParallelTerminationStrategy: PID 25908 died... 16:44:57.454376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25908): Terminated: ok {rc=0} 16:44:57.542699 bus /sierra_3: Setting Powered False 16:44:58.640574 bus /sierra_3: Setting Powered False 16:44:59.755563 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:45:01.023234 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:01.031618 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:45:01.067642 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:45:01.096557 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:45:01.158167 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:45:01.198362 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:45:01.234442 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:45:01.791555 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:45:01.877731 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:01.890304 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:45:01.972547 tst mo_mt_call.py: using LAC 29293 16:45:02.160703 tst mo_mt_call.py: using RAC 223 16:45:02.309786 tst mo_mt_call.py: using CellId 29293 16:45:02.427870 tst mo_mt_call.py: using BVCI 29294 16:45:02.535581 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:02.546962 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:02.558222 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:02.569772 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:02.581325 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:02.592572 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:45:02.710008 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:45:02.833119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:03.325224 run create_hlr_db(pid=25917): Launched 16:45:03.455058 bus /sierra_2: Setting Powered False 16:45:04.518162 run create_hlr_db(pid=25917): Terminated: ok {rc=0} 16:45:04.962715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25919): Launched 16:45:05.280821 run osmo-hlr_10.42.42.2(pid=25920): Launched 16:45:05.403102 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:05.954850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25922): Launched 16:45:06.273375 run osmo-stp_10.42.42.5(pid=25923): Launched 16:45:06.394586 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:06.971065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25925): Launched 16:45:07.288688 run osmo-msc_10.42.42.6(pid=25926): Launched 16:45:07.466708 run osmo-stp_10.42.42.5(pid=25923): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25923)] 16:45:07.600399 run osmo-stp_10.42.42.5(pid=25923): stdout: | (launched: 2022-12-10_16:45:06.215421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:07.735538 run osmo-stp_10.42.42.5(pid=25923): stderr: | [0;m[38;5;43m20221210164506409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164506410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164506410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164506410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:07.869892 run osmo-stp_10.42.42.5(pid=25923): stdout: | (launched: 2022-12-10_16:45:06.215421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:07.996742 run osmo-stp_10.42.42.5(pid=25923): stderr: | [0;m[38;5;43m20221210164506409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164506410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164506410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164506410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164506411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:08.148831 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25923): Process ended prematurely: osmo-stp_10.42.42.5(pid=25923) [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25923)] [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:45:08.158568 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:45:08.186810 run osmo-hlr_10.42.42.2(pid=25920): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25920)] 16:45:08.237053 run osmo-hlr_10.42.42.2(pid=25920): stdout: | (launched: 2022-12-10_16:45:05.222947) 16:45:08.288726 run osmo-hlr_10.42.42.2(pid=25920): stderr: | [0;m[1;31m20221210164505422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164505422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164505422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164505422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164505422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164505422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164505434 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164505442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164505442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164505442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:08.361283 run osmo-msc_10.42.42.6(pid=25926): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25926)] 16:45:08.411709 run osmo-msc_10.42.42.6(pid=25926): stdout: | (launched: 2022-12-10_16:45:07.230674) 16:45:08.462899 run osmo-msc_10.42.42.6(pid=25926): stderr: | [0;m[38;5;43m20221210164507554 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164507554 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6a97446c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164507554 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164507554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164507554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164507554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164507556 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164507556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164507556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164507557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:08.514417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25919): Terminating (SIGTERM) 16:45:08.556315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25922): Terminating (SIGTERM) 16:45:08.598470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25925): Terminating (SIGTERM) 16:45:08.641056 --- ParallelTerminationStrategy: PID 25919 died... 16:45:08.661384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25919): Terminated: ok {rc=0} 16:45:08.708363 --- ParallelTerminationStrategy: PID 25922 died... 16:45:08.728019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25922): Terminated: ok {rc=0} 16:45:08.774931 --- ParallelTerminationStrategy: PID 25925 died... 16:45:08.794757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25925): Terminated: ok {rc=0} 16:45:08.882930 bus /sierra_3: Setting Powered False 16:45:09.983627 bus /sierra_3: Setting Powered False 16:45:11.104341 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:45:12.251227 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:12.263281 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:45:12.334549 tst mo_mt_call_osmux.py: using LAC 29294 16:45:12.451763 tst mo_mt_call_osmux.py: using RAC 224 16:45:12.567393 tst mo_mt_call_osmux.py: using CellId 29294 16:45:12.683588 tst mo_mt_call_osmux.py: using BVCI 29295 16:45:12.791774 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:12.803207 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:12.814557 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:12.826436 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:12.838216 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:12.849961 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:45:12.967686 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:45:13.082989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:13.546642 run create_hlr_db(pid=25928): Launched 16:45:13.661482 bus /sierra_2: Setting Powered False 16:45:14.719612 run create_hlr_db(pid=25928): Terminated: ok {rc=0} 16:45:15.156722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25930): Launched 16:45:15.474993 run osmo-hlr_10.42.42.2(pid=25931): Launched 16:45:15.597427 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:16.185694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25933): Launched 16:45:16.527272 run osmo-stp_10.42.42.5(pid=25934): Launched 16:45:16.669398 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:17.387851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25936): Launched 16:45:17.700653 run osmo-msc_10.42.42.6(pid=25937): Launched 16:45:17.868234 run osmo-stp_10.42.42.5(pid=25934): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25934)] 16:45:17.995068 run osmo-stp_10.42.42.5(pid=25934): stdout: | (launched: 2022-12-10_16:45:16.455900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:18.122199 run osmo-stp_10.42.42.5(pid=25934): stderr: | [0;m[38;5;43m20221210164516838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164516838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164516838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164516838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164516839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164516839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164516839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:18.247941 run osmo-stp_10.42.42.5(pid=25934): stdout: | (launched: 2022-12-10_16:45:16.455900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:18.367810 run osmo-stp_10.42.42.5(pid=25934): stderr: | [0;m[38;5;43m20221210164516838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164516838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164516838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164516838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164516839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164516839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164516839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:18.511280 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25934): Process ended prematurely: osmo-stp_10.42.42.5(pid=25934) [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25934)] [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:45:18.520244 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:45:18.547237 run osmo-hlr_10.42.42.2(pid=25931): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25931)] 16:45:18.595368 run osmo-hlr_10.42.42.2(pid=25931): stdout: | (launched: 2022-12-10_16:45:15.416771) 16:45:18.645133 run osmo-hlr_10.42.42.2(pid=25931): stderr: | [0;m[1;31m20221210164515616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164515616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164515616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164515616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164515616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164515616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164515628 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164515636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164515636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164515636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:18.714326 run osmo-msc_10.42.42.6(pid=25937): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25937)] 16:45:18.761986 run osmo-msc_10.42.42.6(pid=25937): stdout: | (launched: 2022-12-10_16:45:17.645878) 16:45:18.811421 run osmo-msc_10.42.42.6(pid=25937): stderr: | [0;m[38;5;43m20221210164517913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164517913 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8bfb1dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164517914 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164517914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164517914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164517914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164517916 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164517916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164517916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164517916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:18.861403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25930): Terminating (SIGTERM) 16:45:18.901364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25933): Terminating (SIGTERM) 16:45:18.941390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25936): Terminating (SIGTERM) 16:45:18.981731 --- ParallelTerminationStrategy: PID 25930 died... 16:45:19.001061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25930): Terminated: ok {rc=0} 16:45:19.046522 --- ParallelTerminationStrategy: PID 25933 died... 16:45:19.065401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25933): Terminated: ok {rc=0} 16:45:19.109858 --- ParallelTerminationStrategy: PID 25936 died... 16:45:19.128718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25936): Terminated: ok {rc=0} 16:45:19.214994 bus /sierra_3: Setting Powered False 16:45:20.315096 bus /sierra_3: Setting Powered False 16:45:21.430325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:45:22.684739 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:22.693393 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:45:22.725772 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 16:45:22.752013 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 16:45:22.801391 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:45:22.833395 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 16:45:22.859926 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 16:45:23.414490 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 16:45:23.462448 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:23.474167 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:45:23.528248 tst mo_mt_call.py: using LAC 29295 16:45:23.644133 tst mo_mt_call.py: using RAC 225 16:45:23.759277 tst mo_mt_call.py: using CellId 29295 16:45:23.879475 tst mo_mt_call.py: using BVCI 29296 16:45:23.988309 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:23.999695 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:24.010781 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:24.022272 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:24.033771 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:24.045169 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:24.162265 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:24.277907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:24.740742 run create_hlr_db(pid=25943): Launched 16:45:24.854675 bus /sierra_2: Setting Powered False 16:45:25.915133 run create_hlr_db(pid=25943): Terminated: ok {rc=0} 16:45:26.333865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25945): Launched 16:45:26.634090 run osmo-hlr_10.42.42.2(pid=25946): Launched 16:45:26.747655 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:27.259251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25948): Launched 16:45:27.557107 run osmo-stp_10.42.42.5(pid=25949): Launched 16:45:27.670283 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:28.208633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25951): Launched 16:45:28.506501 run osmo-msc_10.42.42.6(pid=25952): Launched 16:45:28.673290 run osmo-stp_10.42.42.5(pid=25949): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25949)] 16:45:28.799309 run osmo-stp_10.42.42.5(pid=25949): stdout: | (launched: 2022-12-10_16:45:27.502098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:28.925593 run osmo-stp_10.42.42.5(pid=25949): stderr: | [0;m[38;5;43m20221210164527674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164527674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164527675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164527675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164527677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164527677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164527677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:29.049754 run osmo-stp_10.42.42.5(pid=25949): stdout: | (launched: 2022-12-10_16:45:27.502098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:29.168166 run osmo-stp_10.42.42.5(pid=25949): stderr: | [0;m[38;5;43m20221210164527674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164527674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164527675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164527675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164527677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164527677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164527677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:29.310529 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25949): Process ended prematurely: osmo-stp_10.42.42.5(pid=25949) [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25949)] [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 16:45:29.319238 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 16:45:29.346049 run osmo-hlr_10.42.42.2(pid=25946): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25946)] 16:45:29.394210 run osmo-hlr_10.42.42.2(pid=25946): stdout: | (launched: 2022-12-10_16:45:26.578822) 16:45:29.444072 run osmo-hlr_10.42.42.2(pid=25946): stderr: | [0;m[1;31m20221210164526753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164526753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164526754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164526754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164526754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164526754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164526766 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164526774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164526774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164526774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:29.513662 run osmo-msc_10.42.42.6(pid=25952): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25952)] 16:45:29.561480 run osmo-msc_10.42.42.6(pid=25952): stdout: | (launched: 2022-12-10_16:45:28.451490) 16:45:29.611408 run osmo-msc_10.42.42.6(pid=25952): stderr: | [0;m[38;5;43m20221210164528723 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164528724 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faf09e86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164528724 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164528724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164528724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164528724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164528726 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164528726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164528726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164528727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:29.661704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25945): Terminating (SIGTERM) 16:45:29.701870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25948): Terminating (SIGTERM) 16:45:29.741993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25951): Terminating (SIGTERM) 16:45:29.782579 --- ParallelTerminationStrategy: PID 25945 died... 16:45:29.801861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25945): Terminated: ok {rc=0} 16:45:29.846909 --- ParallelTerminationStrategy: PID 25948 died... 16:45:29.865664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25948): Terminated: ok {rc=0} 16:45:29.910016 --- ParallelTerminationStrategy: PID 25951 died... 16:45:29.928737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25951): Terminated: ok {rc=0} 16:45:30.013272 bus /sierra_3: Setting Powered False 16:45:31.128510 bus /sierra_3: Setting Powered False 16:45:32.255870 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 16:45:33.402998 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:33.415152 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:45:33.464320 tst mo_mt_call_osmux.py: using LAC 29296 16:45:33.583311 tst mo_mt_call_osmux.py: using RAC 226 16:45:33.701058 tst mo_mt_call_osmux.py: using CellId 29296 16:45:33.819516 tst mo_mt_call_osmux.py: using BVCI 29297 16:45:33.929310 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:33.940571 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:33.951795 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:33.963119 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:33.974663 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:33.986111 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:34.108448 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:34.225311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:34.687839 run create_hlr_db(pid=25954): Launched 16:45:34.801089 bus /sierra_2: Setting Powered False 16:45:35.861607 run create_hlr_db(pid=25954): Terminated: ok {rc=0} 16:45:36.279804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25956): Launched 16:45:36.578533 run osmo-hlr_10.42.42.2(pid=25957): Launched 16:45:36.691270 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:37.201718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25959): Launched 16:45:37.501505 run osmo-stp_10.42.42.5(pid=25960): Launched 16:45:37.615695 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:38.157478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25962): Launched 16:45:38.457069 run osmo-msc_10.42.42.6(pid=25963): Launched 16:45:38.624806 run osmo-stp_10.42.42.5(pid=25960): ERR: Terminated: ERROR {rc=1} [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25960)] 16:45:38.751449 run osmo-stp_10.42.42.5(pid=25960): stdout: | (launched: 2022-12-10_16:45:37.446218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:38.879190 run osmo-stp_10.42.42.5(pid=25960): stderr: | [0;m[38;5;43m20221210164537615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164537615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164537616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164537616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164537618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164537619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164537619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:39.003840 run osmo-stp_10.42.42.5(pid=25960): stdout: | (launched: 2022-12-10_16:45:37.446218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:39.123242 run osmo-stp_10.42.42.5(pid=25960): stderr: | [0;m[38;5;43m20221210164537615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164537615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164537616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164537616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164537618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164537619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164537619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:39.266602 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25960): Process ended prematurely: osmo-stp_10.42.42.5(pid=25960) [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25960)] [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 16:45:39.275494 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 16:45:39.302368 run osmo-hlr_10.42.42.2(pid=25957): ERR: Terminated: ERROR {rc=237} [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25957)] 16:45:39.350735 run osmo-hlr_10.42.42.2(pid=25957): stdout: | (launched: 2022-12-10_16:45:36.523615) 16:45:39.400731 run osmo-hlr_10.42.42.2(pid=25957): stderr: | [0;m[1;31m20221210164536704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164536704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164536704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164536704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164536704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164536704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164536715 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164536723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164536723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164536723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:39.470516 run osmo-msc_10.42.42.6(pid=25963): ERR: Terminated: ERROR {rc=2} [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25963)] 16:45:39.518284 run osmo-msc_10.42.42.6(pid=25963): stdout: | (launched: 2022-12-10_16:45:38.401783) 16:45:39.567986 run osmo-msc_10.42.42.6(pid=25963): stderr: | [0;m[38;5;43m20221210164538674 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164538675 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3afdce7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164538675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164538675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164538675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164538675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164538677 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164538677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164538678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164538678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:39.618037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25956): Terminating (SIGTERM) 16:45:39.658290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25959): Terminating (SIGTERM) 16:45:39.698331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25962): Terminating (SIGTERM) 16:45:39.738577 --- ParallelTerminationStrategy: PID 25956 died... 16:45:39.757754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25956): Terminated: ok {rc=0} 16:45:39.802849 --- ParallelTerminationStrategy: PID 25959 died... 16:45:39.821658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25959): Terminated: ok {rc=0} 16:45:39.866723 --- ParallelTerminationStrategy: PID 25962 died... 16:45:39.885530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25962): Terminated: ok {rc=0} 16:45:39.968899 bus /sierra_3: Setting Powered False 16:45:41.064482 bus /sierra_3: Setting Powered False 16:45:42.180042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 emergency:nanobts+band-900 --------------------------------------------------------------------- 16:45:43.444267 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:43.450623 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:45:43.484244 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 16:45:43.510803 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 16:45:43.592143 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:45:43.624641 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 16:45:43.651667 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 16:45:44.235156 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2376 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 16:45:44.240073 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:44.250700 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 16:45:44.298958 tst emergency_mo_mt_call.py: using LAC 29297 16:45:44.414321 tst emergency_mo_mt_call.py: using RAC 227 16:45:44.527963 tst emergency_mo_mt_call.py: using CellId 29297 16:45:44.650649 tst emergency_mo_mt_call.py: using BVCI 29298 16:45:44.763922 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:44.775272 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:44.786520 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:44.797944 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:44.809403 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:44.820860 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:45:44.933212 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:45:45.045779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:45.498901 run create_hlr_db(pid=25968): Launched 16:45:45.611035 bus /sierra_2: Setting Powered False 16:45:46.668503 run create_hlr_db(pid=25968): Terminated: ok {rc=0} 16:45:47.094312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25970): Launched 16:45:47.421424 run osmo-hlr_10.42.42.2(pid=25971): Launched 16:45:47.542423 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:48.087704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25973): Launched 16:45:48.399225 run osmo-stp_10.42.42.5(pid=25974): Launched 16:45:48.528611 tst emergency_mo_mt_call.py: using MSISDN 7798 16:45:48.690921 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:49.253714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25976): Launched 16:45:49.566444 run osmo-msc_10.42.42.6(pid=25977): Launched 16:45:49.741758 run osmo-stp_10.42.42.5(pid=25974): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25974)] 16:45:49.874072 run osmo-stp_10.42.42.5(pid=25974): stdout: | (launched: 2022-12-10_16:45:48.342315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:50.006856 run osmo-stp_10.42.42.5(pid=25974): stderr: | [0;m[38;5;43m20221210164548533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164548533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164548533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164548534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164548534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164548534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164548534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:50.139747 run osmo-stp_10.42.42.5(pid=25974): stdout: | (launched: 2022-12-10_16:45:48.342315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:50.264666 run osmo-stp_10.42.42.5(pid=25974): stderr: | [0;m[38;5;43m20221210164548533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164548533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164548533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164548534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164548534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164548534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164548534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:50.414326 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25974): Process ended prematurely: osmo-stp_10.42.42.5(pid=25974) [trial-2376↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25974)] [trial-2376↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 16:45:50.423145 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 16:45:50.451013 run osmo-hlr_10.42.42.2(pid=25971): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25971)] 16:45:50.501662 run osmo-hlr_10.42.42.2(pid=25971): stdout: | (launched: 2022-12-10_16:45:47.364298) 16:45:50.553913 run osmo-hlr_10.42.42.2(pid=25971): stderr: | [0;m[1;31m20221210164547560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164547560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164547560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164547560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164547560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164547560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164547573 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164547581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164547582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164547582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:50.626956 run osmo-msc_10.42.42.6(pid=25977): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25977)] 16:45:50.677375 run osmo-msc_10.42.42.6(pid=25977): stdout: | (launched: 2022-12-10_16:45:49.509297) 16:45:50.729116 run osmo-msc_10.42.42.6(pid=25977): stderr: | [0;m[38;5;43m20221210164549830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164549830 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fda5dfa2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164549831 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164549831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164549831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164549831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164549833 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164549833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164549833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164549834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:50.781245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25970): Terminating (SIGTERM) 16:45:50.823024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25973): Terminating (SIGTERM) 16:45:50.864797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25976): Terminating (SIGTERM) 16:45:50.907225 --- ParallelTerminationStrategy: PID 25970 died... 16:45:50.927466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25970): Terminated: ok {rc=0} 16:45:50.973974 --- ParallelTerminationStrategy: PID 25973 died... 16:45:50.993710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25973): Terminated: ok {rc=0} 16:45:51.039612 --- ParallelTerminationStrategy: PID 25976 died... 16:45:51.059274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25976): Terminated: ok {rc=0} 16:45:51.146877 bus /sierra_3: Setting Powered False 16:45:52.247353 bus /sierra_3: Setting Powered False 16:45:53.362275 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 16:45:54.447748 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:54.459735 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 16:45:54.511115 tst emergency_preemptive_call.py: using LAC 29298 16:45:54.635924 tst emergency_preemptive_call.py: using RAC 228 16:45:54.760167 tst emergency_preemptive_call.py: using CellId 29298 16:45:54.877434 tst emergency_preemptive_call.py: using BVCI 29299 16:45:54.991155 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:55.002672 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:55.013982 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:55.025238 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:55.036395 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:45:55.047833 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:45:55.161189 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:45:55.279125 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:45:55.396148 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:45:55.513414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:56.001059 run create_hlr_db(pid=25979): Launched 16:45:56.128480 bus /sierra_2: Setting Powered False 16:45:57.192189 run create_hlr_db(pid=25979): Terminated: ok {rc=0} 16:45:57.630793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25981): Launched 16:45:57.945589 run osmo-hlr_10.42.42.2(pid=25982): Launched 16:45:58.065518 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:58.608459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Launched 16:45:58.922291 run osmo-stp_10.42.42.5(pid=25985): Launched 16:45:59.050768 tst emergency_preemptive_call.py: using MSISDN 7799 16:45:59.211306 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:59.774555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25987): Launched 16:46:00.087343 run osmo-msc_10.42.42.6(pid=25988): Launched 16:46:00.261183 run osmo-stp_10.42.42.5(pid=25985): ERR: Terminated: ERROR {rc=1} [trial-2376↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] 16:46:00.392813 run osmo-stp_10.42.42.5(pid=25985): stdout: | (launched: 2022-12-10_16:45:58.864743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:00.525415 run osmo-stp_10.42.42.5(pid=25985): stderr: | [0;m[38;5;43m20221210164559055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164559055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164559055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164559055 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164559056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164559056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164559056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:00.657787 run osmo-stp_10.42.42.5(pid=25985): stdout: | (launched: 2022-12-10_16:45:58.864743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:00.783401 run osmo-stp_10.42.42.5(pid=25985): stderr: | [0;m[38;5;43m20221210164559055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164559055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164559055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164559055 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164559056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164559056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164559056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:00.952018 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25985): Process ended prematurely: osmo-stp_10.42.42.5(pid=25985) [trial-2376↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] [trial-2376↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 16:46:00.961522 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 16:46:00.990534 run osmo-hlr_10.42.42.2(pid=25982): ERR: Terminated: ERROR {rc=237} [trial-2376↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25982)] 16:46:01.041889 run osmo-hlr_10.42.42.2(pid=25982): stdout: | (launched: 2022-12-10_16:45:57.888063) 16:46:01.095377 run osmo-hlr_10.42.42.2(pid=25982): stderr: | [0;m[1;31m20221210164558087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164558087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164558087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164558087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164558087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164558087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164558100 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164558108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164558108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164558108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:01.169972 run osmo-msc_10.42.42.6(pid=25988): ERR: Terminated: ERROR {rc=2} [trial-2376↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25988)] 16:46:01.221647 run osmo-msc_10.42.42.6(pid=25988): stdout: | (launched: 2022-12-10_16:46:00.029987) 16:46:01.275024 run osmo-msc_10.42.42.6(pid=25988): stderr: | [0;m[38;5;43m20221210164600349 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210164600350 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f68ecf10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210164600350 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210164600350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210164600350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210164600350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210164600352 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210164600352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210164600352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210164600353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:46:01.329078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25981): Terminating (SIGTERM) 16:46:01.372452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Terminating (SIGTERM) 16:46:01.415797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25987): Terminating (SIGTERM) 16:46:01.459870 --- ParallelTerminationStrategy: PID 25981 died... 16:46:01.480186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25981): Terminated: ok {rc=0} 16:46:01.529998 --- ParallelTerminationStrategy: PID 25984 died... 16:46:01.550518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Terminated: ok {rc=0} 16:46:01.598535 --- ParallelTerminationStrategy: PID 25987 died... 16:46:01.619007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25987): Terminated: ok {rc=0} 16:46:01.710653 bus /sierra_9: Setting Powered False 16:46:02.809172 bus /sierra_9: Setting Powered False 16:46:03.926362 bus /sierra_8: Setting Powered False 16:46:05.026611 bus /sierra_8: Setting Powered False 16:46:06.142777 bus /sierra_3: Setting Powered False 16:46:07.242871 bus /sierra_3: Setting Powered False 16:46:08.356519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-900 --------------------------------------------------------------------- 16:46:09.630130 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:46:09.636261 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:46:09.669683 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 16:46:09.709125 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 16:46:09.797900 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:46:09.830608 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 16:46:09.869707 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 16:46:10.462705 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 16:46:10.515040 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:10.526340 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:46:10.574607 tst cs_paging_gprs_active.py: using LAC 29299 16:46:10.701428 tst cs_paging_gprs_active.py: using RAC 229 16:46:10.821049 tst cs_paging_gprs_active.py: using CellId 29299 16:46:10.947295 tst cs_paging_gprs_active.py: using BVCI 29300 16:46:11.063215 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:11.074488 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:11.085497 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:11.096388 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:11.107296 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:11.118278 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:11.129332 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:11.140197 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:11.151290 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:11.265377 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:11.382299 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:46:11.583349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:11.883168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25993): Launched 16:46:12.144334 run iperf3-srv_10.42.42.10(pid=25994): Launched 16:46:12.256139 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:46:12.457399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:12.757393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25995): Launched 16:46:13.018142 run iperf3-srv_10.42.42.10(pid=25996): Launched 16:46:13.129695 tst cs_paging_gprs_active.py:38: start network... 16:46:13.329703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:13.790044 run create_hlr_db(pid=25997): Launched 16:46:13.904882 bus /sierra_2: Setting Powered False 16:46:14.964936 run create_hlr_db(pid=25997): Terminated: ok {rc=0} 16:46:15.403263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25999): Launched 16:46:15.723091 run osmo-hlr_10.42.42.2(pid=26000): Launched 16:46:15.879514 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:16.523221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26002): Launched 16:46:16.866546 run osmo-stp_10.42.42.5(pid=26003): Launched 16:46:17.140766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:46:17.680569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26005): Launched 16:46:17.795337 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:46:18.048031 run patchelf(pid=26006): Launched 16:46:18.214624 run osmo-stp_10.42.42.5(pid=26003): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26003)] 16:46:18.341301 run osmo-stp_10.42.42.5(pid=26003): stdout: | (launched: 2022-12-10_16:46:16.803285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:18.469833 run osmo-stp_10.42.42.5(pid=26003): stderr: | [0;m[38;5;43m20221210164617042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164617042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164617042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164617043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164617043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164617043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164617043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:18.599274 run osmo-stp_10.42.42.5(pid=26003): stdout: | (launched: 2022-12-10_16:46:16.803285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:18.721864 run osmo-stp_10.42.42.5(pid=26003): stderr: | [0;m[38;5;43m20221210164617042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164617042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164617042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164617043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164617043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164617043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164617043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:18.867341 run patchelf(pid=26006): Terminating (SIGINT) 16:46:19.035571 run patchelf(pid=26006): Terminated: ok {rc=0} 16:46:19.157331 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26003): Process ended prematurely: osmo-stp_10.42.42.5(pid=26003) [trial-2376↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26003)] [trial-2376↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 16:46:19.166667 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:46:19.194701 run osmo-hlr_10.42.42.2(pid=26000): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26000)] 16:46:19.242575 run osmo-hlr_10.42.42.2(pid=26000): stdout: | (launched: 2022-12-10_16:46:15.664769) 16:46:19.292088 run osmo-hlr_10.42.42.2(pid=26000): stderr: | [0;m[1;31m20221210164615882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164615882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164615882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164615882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164615882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164615882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164615899 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164615922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164615922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164615922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:19.341963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25993): Terminating (SIGTERM) 16:46:19.381956 run iperf3-srv_10.42.42.10(pid=25994): Terminating (SIGTERM) 16:46:19.421893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25995): Terminating (SIGTERM) 16:46:19.461917 run iperf3-srv_10.42.42.10(pid=25996): Terminating (SIGTERM) 16:46:19.501876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25999): Terminating (SIGTERM) 16:46:19.542006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26002): Terminating (SIGTERM) 16:46:19.582102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26005): Terminating (SIGTERM) 16:46:19.622844 --- ParallelTerminationStrategy: PID 25993 died... 16:46:19.642208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25993): Terminated: ok {rc=0} 16:46:19.687359 --- ParallelTerminationStrategy: PID 25994 died... 16:46:19.706234 run iperf3-srv_10.42.42.10(pid=25994): Terminated {rc=256} 16:46:19.750599 --- ParallelTerminationStrategy: PID 25995 died... 16:46:19.769318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25995): Terminated: ok {rc=0} 16:46:19.813866 --- ParallelTerminationStrategy: PID 25996 died... 16:46:19.832579 run iperf3-srv_10.42.42.10(pid=25996): Terminated {rc=256} 16:46:19.876905 --- ParallelTerminationStrategy: PID 25999 died... 16:46:19.895712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25999): Terminated: ok {rc=0} 16:46:19.940177 --- ParallelTerminationStrategy: PID 26002 died... 16:46:19.959056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26002): Terminated: ok {rc=0} 16:46:20.004005 --- ParallelTerminationStrategy: PID 26005 died... 16:46:20.022957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26005): Terminated: ok {rc=0} 16:46:20.108385 bus /gobi_0: Setting Powered False 16:46:21.207587 bus /gobi_0: Setting Powered False 16:46:22.320301 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 16:46:23.468382 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:23.480098 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:46:23.535197 tst iperf3.py: using LAC 29300 16:46:23.660654 tst iperf3.py: using RAC 230 16:46:23.787055 tst iperf3.py: using CellId 29300 16:46:23.913087 tst iperf3.py: using BVCI 29301 16:46:24.024330 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:24.035281 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:24.046063 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:24.057025 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:24.067815 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:24.078692 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:24.089516 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:24.100194 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:24.111018 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:24.228814 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:46:24.430339 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:24.731685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26007): Launched 16:46:24.992604 run iperf3-srv_10.42.42.10(pid=26008): Launched 16:46:25.104842 tst iperf3.py:8: start network... 16:46:25.305477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:25.768781 run create_hlr_db(pid=26009): Launched 16:46:25.882877 bus /gobi_6: Setting Powered False 16:46:26.942442 run create_hlr_db(pid=26009): Terminated: ok {rc=0} 16:46:27.380442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26011): Launched 16:46:27.700699 run osmo-hlr_10.42.42.2(pid=26012): Launched 16:46:27.822870 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:28.378325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26014): Launched 16:46:28.697838 run osmo-stp_10.42.42.5(pid=26015): Launched 16:46:28.818685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:46:29.368482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26017): Launched 16:46:29.490328 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:46:29.759734 run patchelf(pid=26018): Launched 16:46:29.936748 run osmo-stp_10.42.42.5(pid=26015): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26015)] 16:46:30.071919 run osmo-stp_10.42.42.5(pid=26015): stdout: | (launched: 2022-12-10_16:46:28.639251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:30.208794 run osmo-stp_10.42.42.5(pid=26015): stderr: | [0;m[38;5;43m20221210164628831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164628831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164628831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164628831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164628832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164628832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164628832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:30.346238 run osmo-stp_10.42.42.5(pid=26015): stdout: | (launched: 2022-12-10_16:46:28.639251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:30.476761 run osmo-stp_10.42.42.5(pid=26015): stderr: | [0;m[38;5;43m20221210164628831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164628831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164628831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164628831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164628832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164628832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164628832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:30.631609 run patchelf(pid=26018): Terminating (SIGINT) 16:46:30.810737 run patchelf(pid=26018): Terminated: ok {rc=0} 16:46:30.945276 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26015): Process ended prematurely: osmo-stp_10.42.42.5(pid=26015) [trial-2376↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26015)] [trial-2376↪gprs:nanobts+band-900↪iperf3.py:8] 16:46:30.955739 tst iperf3.py:8: Test FAILED (7.5 sec) 16:46:30.986711 run osmo-hlr_10.42.42.2(pid=26012): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26012)] 16:46:31.038038 run osmo-hlr_10.42.42.2(pid=26012): stdout: | (launched: 2022-12-10_16:46:27.641990) 16:46:31.090473 run osmo-hlr_10.42.42.2(pid=26012): stderr: | [0;m[1;31m20221210164627841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164627841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164627841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164627841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164627841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164627841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164627853 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164627861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164627862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164627862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:31.143553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26007): Terminating (SIGTERM) 16:46:31.186758 run iperf3-srv_10.42.42.10(pid=26008): Terminating (SIGTERM) 16:46:31.233284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26011): Terminating (SIGTERM) 16:46:31.276792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26014): Terminating (SIGTERM) 16:46:31.321925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26017): Terminating (SIGTERM) 16:46:31.367485 --- ParallelTerminationStrategy: PID 26007 died... 16:46:31.387682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26007): Terminated: ok {rc=0} 16:46:31.438473 --- ParallelTerminationStrategy: PID 26008 died... 16:46:31.458414 run iperf3-srv_10.42.42.10(pid=26008): Terminated {rc=256} 16:46:31.506250 --- ParallelTerminationStrategy: PID 26011 died... 16:46:31.526257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26011): Terminated: ok {rc=0} 16:46:31.578709 --- ParallelTerminationStrategy: PID 26014 died... 16:46:31.602767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26014): Terminated: ok {rc=0} 16:46:31.662114 --- ParallelTerminationStrategy: PID 26017 died... 16:46:31.688191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26017): Terminated: ok {rc=0} 16:46:31.795901 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 16:46:32.957693 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:32.969450 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:46:33.016833 tst iperf3m4.py: using LAC 29301 16:46:33.141770 tst iperf3m4.py: using RAC 231 16:46:33.267176 tst iperf3m4.py: using CellId 29301 16:46:33.394445 tst iperf3m4.py: using BVCI 29302 16:46:33.511506 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:33.522791 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:33.533768 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:33.544693 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:33.555664 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:33.566720 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:33.577928 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:33.588793 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:33.599924 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:33.714267 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:33.836493 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:33.952618 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:34.066272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:46:34.268127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:34.569518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26019): Launched 16:46:34.831163 run iperf3-srv_10.42.42.10(pid=26020): Launched 16:46:34.943277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:46:35.143193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:35.443320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26021): Launched 16:46:35.703025 run iperf3-srv_10.42.42.10(pid=26022): Launched 16:46:35.815067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:46:36.014500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:36.315216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26023): Launched 16:46:36.574959 run iperf3-srv_10.42.42.10(pid=26024): Launched 16:46:36.686625 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:46:36.885877 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:37.185918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26025): Launched 16:46:37.446255 run iperf3-srv_10.42.42.10(pid=26026): Launched 16:46:37.558042 tst iperf3m4.py:8: start network... 16:46:37.757867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:38.219820 run create_hlr_db(pid=26027): Launched 16:46:38.334694 bus /gobi_6: Setting Powered False 16:46:39.394667 run create_hlr_db(pid=26027): Terminated: ok {rc=0} 16:46:39.832457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26029): Launched 16:46:40.153343 run osmo-hlr_10.42.42.2(pid=26030): Launched 16:46:40.275025 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:40.827680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26032): Launched 16:46:41.147621 run osmo-stp_10.42.42.5(pid=26033): Launched 16:46:41.268556 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:46:41.819590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26035): Launched 16:46:41.941768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:46:42.211861 run patchelf(pid=26036): Launched 16:46:42.389118 run osmo-stp_10.42.42.5(pid=26033): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26033)] 16:46:42.524454 run osmo-stp_10.42.42.5(pid=26033): stdout: | (launched: 2022-12-10_16:46:41.089069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:42.662072 run osmo-stp_10.42.42.5(pid=26033): stderr: | [0;m[38;5;43m20221210164641277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164641277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164641277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164641277 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164641278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164641278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164641278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:42.799473 run osmo-stp_10.42.42.5(pid=26033): stdout: | (launched: 2022-12-10_16:46:41.089069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:42.930558 run osmo-stp_10.42.42.5(pid=26033): stderr: | [0;m[38;5;43m20221210164641277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164641277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164641277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164641277 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164641278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164641278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164641278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:43.085534 run patchelf(pid=26036): Terminating (SIGINT) 16:46:43.265298 run patchelf(pid=26036): Terminated: ok {rc=0} 16:46:43.394598 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26033): Process ended prematurely: osmo-stp_10.42.42.5(pid=26033) [trial-2376↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26033)] [trial-2376↪gprs:nanobts+band-900↪iperf3m4.py:8] 16:46:43.404578 tst iperf3m4.py:8: Test FAILED (10.5 sec) 16:46:43.433420 run osmo-hlr_10.42.42.2(pid=26030): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26030)] 16:46:43.483129 run osmo-hlr_10.42.42.2(pid=26030): stdout: | (launched: 2022-12-10_16:46:40.094466) 16:46:43.534521 run osmo-hlr_10.42.42.2(pid=26030): stderr: | [0;m[1;31m20221210164640289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164640289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164640289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164640290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164640290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164640290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164640302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164640310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164640310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164640310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:43.586233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26019): Terminating (SIGTERM) 16:46:43.627748 run iperf3-srv_10.42.42.10(pid=26020): Terminating (SIGTERM) 16:46:43.669672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26021): Terminating (SIGTERM) 16:46:43.711357 run iperf3-srv_10.42.42.10(pid=26022): Terminating (SIGTERM) 16:46:43.752921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26023): Terminating (SIGTERM) 16:46:43.794461 run iperf3-srv_10.42.42.10(pid=26024): Terminating (SIGTERM) 16:46:43.835880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26025): Terminating (SIGTERM) 16:46:43.877613 run iperf3-srv_10.42.42.10(pid=26026): Terminating (SIGTERM) 16:46:43.919014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26029): Terminating (SIGTERM) 16:46:43.960431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26032): Terminating (SIGTERM) 16:46:44.001899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26035): Terminating (SIGTERM) 16:46:44.043673 --- ParallelTerminationStrategy: PID 26019 died... 16:46:44.063771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26019): Terminated: ok {rc=0} 16:46:44.110238 --- ParallelTerminationStrategy: PID 26020 died... 16:46:44.129998 run iperf3-srv_10.42.42.10(pid=26020): Terminated {rc=256} 16:46:44.176501 --- ParallelTerminationStrategy: PID 26021 died... 16:46:44.196582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26021): Terminated: ok {rc=0} 16:46:44.242840 --- ParallelTerminationStrategy: PID 26022 died... 16:46:44.262524 run iperf3-srv_10.42.42.10(pid=26022): Terminated {rc=256} 16:46:44.308622 --- ParallelTerminationStrategy: PID 26023 died... 16:46:44.328430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26023): Terminated: ok {rc=0} 16:46:44.375211 --- ParallelTerminationStrategy: PID 26024 died... 16:46:44.394684 run iperf3-srv_10.42.42.10(pid=26024): Terminated {rc=256} 16:46:44.440784 --- ParallelTerminationStrategy: PID 26025 died... 16:46:44.460840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26025): Terminated: ok {rc=0} 16:46:44.507119 --- ParallelTerminationStrategy: PID 26026 died... 16:46:44.526852 run iperf3-srv_10.42.42.10(pid=26026): Terminated {rc=256} 16:46:44.572856 --- ParallelTerminationStrategy: PID 26029 died... 16:46:44.592840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26029): Terminated: ok {rc=0} 16:46:44.639056 --- ParallelTerminationStrategy: PID 26032 died... 16:46:44.658855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26032): Terminated: ok {rc=0} 16:46:44.705353 --- ParallelTerminationStrategy: PID 26035 died... 16:46:44.725398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26035): Terminated: ok {rc=0} 16:46:44.812276 bus /gobi_4: Setting Powered False 16:46:45.923356 bus /gobi_4: Setting Powered False 16:46:47.060793 bus /gobi_1: Setting Powered False 16:46:48.171964 bus /gobi_1: Setting Powered False 16:46:49.289269 bus /gobi_0: Setting Powered False 16:46:50.388772 bus /gobi_0: Setting Powered False 16:46:51.504660 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900 ping.py ---------------------------------------------- 16:46:52.608566 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:52.622268 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:46:52.669131 tst ping.py: using LAC 29302 16:46:52.783822 tst ping.py: using RAC 232 16:46:52.900338 tst ping.py: using CellId 29302 16:46:53.015412 tst ping.py: using BVCI 29303 16:46:53.122070 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:53.132740 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:53.143285 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:53.154025 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:53.164603 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:53.175216 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:53.186077 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:53.196734 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:53.313871 tst ping.py:19: start network... 16:46:53.526737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:54.012826 run create_hlr_db(pid=26037): Launched 16:46:54.139912 bus /gobi_6: Setting Powered False 16:46:55.199574 run create_hlr_db(pid=26037): Terminated: ok {rc=0} 16:46:55.617794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26039): Launched 16:46:55.911726 run osmo-hlr_10.42.42.2(pid=26040): Launched 16:46:56.022269 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:56.546574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26042): Launched 16:46:56.839296 run osmo-stp_10.42.42.5(pid=26043): Launched 16:46:56.950621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:46:57.455761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26045): Launched 16:46:57.567399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:46:57.815716 run patchelf(pid=26046): Launched 16:46:57.978763 run osmo-stp_10.42.42.5(pid=26043): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26043)] 16:46:58.103109 run osmo-stp_10.42.42.5(pid=26043): stdout: | (launched: 2022-12-10_16:46:56.785449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:58.228833 run osmo-stp_10.42.42.5(pid=26043): stderr: | [0;m[38;5;43m20221210164656954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164656954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164656954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164656955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164656955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164656955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164656955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:58.355504 run osmo-stp_10.42.42.5(pid=26043): stdout: | (launched: 2022-12-10_16:46:56.785449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:58.475834 run osmo-stp_10.42.42.5(pid=26043): stderr: | [0;m[38;5;43m20221210164656954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164656954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164656954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164656955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164656955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164656955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164656955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:58.618283 run patchelf(pid=26046): Terminating (SIGINT) 16:46:58.783170 run patchelf(pid=26046): Terminated: ok {rc=0} 16:46:58.902051 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26043): Process ended prematurely: osmo-stp_10.42.42.5(pid=26043) [trial-2376↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26043)] [trial-2376↪gprs:nanobts+band-900↪ping.py:22] 16:46:58.910773 tst ping.py:22: Test FAILED (6.3 sec) 16:46:58.938197 run osmo-hlr_10.42.42.2(pid=26040): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26040)] 16:46:58.986341 run osmo-hlr_10.42.42.2(pid=26040): stdout: | (launched: 2022-12-10_16:46:55.857422) 16:46:59.036063 run osmo-hlr_10.42.42.2(pid=26040): stderr: | [0;m[1;31m20221210164656036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164656036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164656036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164656036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164656036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164656036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164656051 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164656060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164656061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164656061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:59.086242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26039): Terminating (SIGTERM) 16:46:59.126348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26042): Terminating (SIGTERM) 16:46:59.166470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26045): Terminating (SIGTERM) 16:46:59.207159 --- ParallelTerminationStrategy: PID 26039 died... 16:46:59.226520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26039): Terminated: ok {rc=0} 16:46:59.271511 --- ParallelTerminationStrategy: PID 26042 died... 16:46:59.290473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26042): Terminated: ok {rc=0} 16:46:59.335140 --- ParallelTerminationStrategy: PID 26045 died... 16:46:59.354062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26045): Terminated: ok {rc=0} 16:46:59.437857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 16:47:00.525398 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:00.537529 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:47:00.588914 tst ping_idle_ping.py: using LAC 29303 16:47:00.714553 tst ping_idle_ping.py: using RAC 233 16:47:00.844792 tst ping_idle_ping.py: using CellId 29303 16:47:00.991223 tst ping_idle_ping.py: using BVCI 29304 16:47:01.112902 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:01.124659 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:01.136348 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:01.148499 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:01.160576 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:01.172722 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:01.185009 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:01.197311 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:47:01.315789 tst ping_idle_ping.py:24: start network... 16:47:01.532909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:02.058037 run create_hlr_db(pid=26047): Launched 16:47:02.193551 bus /gobi_6: Setting Powered False 16:47:03.253719 run create_hlr_db(pid=26047): Terminated: ok {rc=0} 16:47:03.666451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26049): Launched 16:47:03.959948 run osmo-hlr_10.42.42.2(pid=26050): Launched 16:47:04.071757 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:04.592740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26052): Launched 16:47:04.887200 run osmo-stp_10.42.42.5(pid=26053): Launched 16:47:04.999387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:05.507422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26055): Launched 16:47:05.620313 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:05.868391 run patchelf(pid=26056): Launched 16:47:06.031973 run osmo-stp_10.42.42.5(pid=26053): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26053)] 16:47:06.156323 run osmo-stp_10.42.42.5(pid=26053): stdout: | (launched: 2022-12-10_16:47:04.832480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:06.282679 run osmo-stp_10.42.42.5(pid=26053): stderr: | [0;m[38;5;43m20221210164705000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164705000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164705000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164705000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164705003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164705003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164705003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:06.409460 run osmo-stp_10.42.42.5(pid=26053): stdout: | (launched: 2022-12-10_16:47:04.832480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:06.529768 run osmo-stp_10.42.42.5(pid=26053): stderr: | [0;m[38;5;43m20221210164705000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164705000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164705000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164705000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164705003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164705003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164705003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:06.672632 run patchelf(pid=26056): Terminating (SIGINT) 16:47:06.838216 run patchelf(pid=26056): Terminated: ok {rc=0} 16:47:06.957260 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26053): Process ended prematurely: osmo-stp_10.42.42.5(pid=26053) [trial-2376↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26053)] [trial-2376↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 16:47:06.965985 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:47:06.993249 run osmo-hlr_10.42.42.2(pid=26050): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26050)] 16:47:07.041253 run osmo-hlr_10.42.42.2(pid=26050): stdout: | (launched: 2022-12-10_16:47:03.905889) 16:47:07.090936 run osmo-hlr_10.42.42.2(pid=26050): stderr: | [0;m[1;31m20221210164704083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164704083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164704083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164704083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164704083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164704083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164704095 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164704103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164704104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164704104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:07.141130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26049): Terminating (SIGTERM) 16:47:07.181325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26052): Terminating (SIGTERM) 16:47:07.221373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26055): Terminating (SIGTERM) 16:47:07.261896 --- ParallelTerminationStrategy: PID 26049 died... 16:47:07.281217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26049): Terminated: ok {rc=0} 16:47:07.326358 --- ParallelTerminationStrategy: PID 26052 died... 16:47:07.345018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26052): Terminated: ok {rc=0} 16:47:07.389683 --- ParallelTerminationStrategy: PID 26055 died... 16:47:07.408604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26055): Terminated: ok {rc=0} 16:47:07.492505 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 16:47:08.798902 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:47:08.806138 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:47:08.839389 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:47:08.879112 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:47:08.967295 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:47:09.000146 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:47:09.039736 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:47:09.641194 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:47:09.692583 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:09.703921 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:09.753342 tst cs_paging_gprs_active.py: using LAC 29304 16:47:09.877621 tst cs_paging_gprs_active.py: using RAC 234 16:47:10.002041 tst cs_paging_gprs_active.py: using CellId 29304 16:47:10.126906 tst cs_paging_gprs_active.py: using BVCI 29305 16:47:10.242780 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:10.254336 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:10.265505 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:10.276588 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:10.287638 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:10.299215 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:10.310456 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:10.321679 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:10.332821 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:10.448085 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:10.563164 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:47:10.781864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:11.102522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26062): Launched 16:47:11.380239 run iperf3-srv_10.42.42.10(pid=26063): Launched 16:47:11.499729 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:47:11.716605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:12.037947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26064): Launched 16:47:12.315399 run iperf3-srv_10.42.42.10(pid=26065): Launched 16:47:12.435057 tst cs_paging_gprs_active.py:38: start network... 16:47:12.650657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:13.145269 run create_hlr_db(pid=26066): Launched 16:47:13.275073 bus /gobi_6: Setting Powered False 16:47:14.338354 run create_hlr_db(pid=26066): Terminated: ok {rc=0} 16:47:14.784688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26068): Launched 16:47:15.104244 run osmo-hlr_10.42.42.2(pid=26069): Launched 16:47:15.226348 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:15.776277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26071): Launched 16:47:16.115948 run osmo-stp_10.42.42.5(pid=26072): Launched 16:47:16.262974 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:16.967641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26074): Launched 16:47:17.102412 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:17.378018 run patchelf(pid=26075): Launched 16:47:17.555472 run osmo-stp_10.42.42.5(pid=26072): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26072)] 16:47:17.690916 run osmo-stp_10.42.42.5(pid=26072): stdout: | (launched: 2022-12-10_16:47:16.052519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:17.828121 run osmo-stp_10.42.42.5(pid=26072): stderr: | [0;m[38;5;43m20221210164716458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164716458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164716458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164716459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164716459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164716459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164716459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:17.965698 run osmo-stp_10.42.42.5(pid=26072): stdout: | (launched: 2022-12-10_16:47:16.052519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:18.096612 run osmo-stp_10.42.42.5(pid=26072): stderr: | [0;m[38;5;43m20221210164716458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164716458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164716458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164716459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164716459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164716459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164716459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:18.251708 run patchelf(pid=26075): Terminating (SIGINT) 16:47:18.430770 run patchelf(pid=26075): Terminated: ok {rc=0} 16:47:18.560448 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26072): Process ended prematurely: osmo-stp_10.42.42.5(pid=26072) [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26072)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:47:18.570522 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:47:18.599127 run osmo-hlr_10.42.42.2(pid=26069): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26069)] 16:47:18.649096 run osmo-hlr_10.42.42.2(pid=26069): stdout: | (launched: 2022-12-10_16:47:15.045984) 16:47:18.700939 run osmo-hlr_10.42.42.2(pid=26069): stderr: | [0;m[1;31m20221210164715243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164715243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164715243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164715243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164715243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164715243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164715255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164715263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164715263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164715263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:18.753293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26062): Terminating (SIGTERM) 16:47:18.794860 run iperf3-srv_10.42.42.10(pid=26063): Terminating (SIGTERM) 16:47:18.836348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26064): Terminating (SIGTERM) 16:47:18.877909 run iperf3-srv_10.42.42.10(pid=26065): Terminating (SIGTERM) 16:47:18.919200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26068): Terminating (SIGTERM) 16:47:18.960649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26071): Terminating (SIGTERM) 16:47:19.002047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26074): Terminating (SIGTERM) 16:47:19.044015 --- ParallelTerminationStrategy: PID 26062 died... 16:47:19.064111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26062): Terminated: ok {rc=0} 16:47:19.110474 --- ParallelTerminationStrategy: PID 26063 died... 16:47:19.129958 run iperf3-srv_10.42.42.10(pid=26063): Terminated {rc=256} 16:47:19.175816 --- ParallelTerminationStrategy: PID 26064 died... 16:47:19.195428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26064): Terminated: ok {rc=0} 16:47:19.241356 --- ParallelTerminationStrategy: PID 26065 died... 16:47:19.260551 run iperf3-srv_10.42.42.10(pid=26065): Terminated {rc=256} 16:47:19.306735 --- ParallelTerminationStrategy: PID 26068 died... 16:47:19.326314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26068): Terminated: ok {rc=0} 16:47:19.372203 --- ParallelTerminationStrategy: PID 26071 died... 16:47:19.391793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26071): Terminated: ok {rc=0} 16:47:19.437837 --- ParallelTerminationStrategy: PID 26074 died... 16:47:19.457226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26074): Terminated: ok {rc=0} 16:47:19.544155 bus /gobi_0: Setting Powered False 16:47:20.644548 bus /gobi_0: Setting Powered False 16:47:21.758932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:47:22.906409 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:22.918241 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:22.970336 tst iperf3.py: using LAC 29305 16:47:23.097367 tst iperf3.py: using RAC 235 16:47:23.222684 tst iperf3.py: using CellId 29305 16:47:23.346861 tst iperf3.py: using BVCI 29306 16:47:23.462677 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:23.474125 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:23.485278 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:23.496439 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:23.507505 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:23.518595 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:23.529920 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:23.541239 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:23.552416 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:23.665712 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:47:23.868830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:24.170673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26076): Launched 16:47:24.433060 run iperf3-srv_10.42.42.10(pid=26077): Launched 16:47:24.546258 tst iperf3.py:8: start network... 16:47:24.747904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:25.212445 run create_hlr_db(pid=26078): Launched 16:47:25.344056 bus /gobi_6: Setting Powered False 16:47:26.408524 run create_hlr_db(pid=26078): Terminated: ok {rc=0} 16:47:26.855809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26080): Launched 16:47:27.175302 run osmo-hlr_10.42.42.2(pid=26081): Launched 16:47:27.295978 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:27.852870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26083): Launched 16:47:28.171979 run osmo-stp_10.42.42.5(pid=26084): Launched 16:47:28.292607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:28.844628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26086): Launched 16:47:28.966599 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:29.235926 run patchelf(pid=26087): Launched 16:47:29.414192 run osmo-stp_10.42.42.5(pid=26084): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26084)] 16:47:29.549670 run osmo-stp_10.42.42.5(pid=26084): stdout: | (launched: 2022-12-10_16:47:28.113546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:29.687253 run osmo-stp_10.42.42.5(pid=26084): stderr: | [0;m[38;5;43m20221210164728306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164728306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164728306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164728307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164728307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164728307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164728307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:29.824558 run osmo-stp_10.42.42.5(pid=26084): stdout: | (launched: 2022-12-10_16:47:28.113546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:29.955258 run osmo-stp_10.42.42.5(pid=26084): stderr: | [0;m[38;5;43m20221210164728306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164728306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164728306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164728307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164728307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164728307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164728307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:30.110553 run patchelf(pid=26087): Terminating (SIGINT) 16:47:30.289901 run patchelf(pid=26087): Terminated: ok {rc=0} 16:47:30.419078 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26084): Process ended prematurely: osmo-stp_10.42.42.5(pid=26084) [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26084)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 16:47:30.429068 tst iperf3.py:8: Test FAILED (7.6 sec) 16:47:30.457691 run osmo-hlr_10.42.42.2(pid=26081): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26081)] 16:47:30.507497 run osmo-hlr_10.42.42.2(pid=26081): stdout: | (launched: 2022-12-10_16:47:27.116909) 16:47:30.559343 run osmo-hlr_10.42.42.2(pid=26081): stderr: | [0;m[1;31m20221210164727314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164727314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164727314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164727314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164727314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164727314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164727327 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164727335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164727335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164727335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:30.611309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26076): Terminating (SIGTERM) 16:47:30.652934 run iperf3-srv_10.42.42.10(pid=26077): Terminating (SIGTERM) 16:47:30.695091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26080): Terminating (SIGTERM) 16:47:30.736692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26083): Terminating (SIGTERM) 16:47:30.778223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26086): Terminating (SIGTERM) 16:47:30.820494 --- ParallelTerminationStrategy: PID 26076 died... 16:47:30.840586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26076): Terminated: ok {rc=0} 16:47:30.887752 --- ParallelTerminationStrategy: PID 26077 died... 16:47:30.907880 run iperf3-srv_10.42.42.10(pid=26077): Terminated {rc=256} 16:47:30.955010 --- ParallelTerminationStrategy: PID 26080 died... 16:47:30.975251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26080): Terminated: ok {rc=0} 16:47:31.022252 --- ParallelTerminationStrategy: PID 26083 died... 16:47:31.042427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26083): Terminated: ok {rc=0} 16:47:31.089675 --- ParallelTerminationStrategy: PID 26086 died... 16:47:31.109897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26086): Terminated: ok {rc=0} 16:47:31.198016 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:47:32.350754 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.362807 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:32.413121 tst iperf3m4.py: using LAC 29306 16:47:32.532174 tst iperf3m4.py: using RAC 236 16:47:32.653577 tst iperf3m4.py: using CellId 29306 16:47:32.771700 tst iperf3m4.py: using BVCI 29307 16:47:32.880358 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.891433 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.902355 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.914035 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.925557 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.937122 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.948851 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.960251 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.971915 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:33.091794 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:33.210371 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:33.328747 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:33.448739 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:47:33.665992 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:33.988193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26088): Launched 16:47:34.266888 run iperf3-srv_10.42.42.10(pid=26089): Launched 16:47:34.387216 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:47:34.603586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:34.925510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26090): Launched 16:47:35.203794 run iperf3-srv_10.42.42.10(pid=26091): Launched 16:47:35.323241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:47:35.538218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:35.858845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26092): Launched 16:47:36.138355 run iperf3-srv_10.42.42.10(pid=26095): Launched 16:47:36.257687 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:47:36.472373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:36.793815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26096): Launched 16:47:37.070832 run iperf3-srv_10.42.42.10(pid=26097): Launched 16:47:37.190210 tst iperf3m4.py:8: start network... 16:47:37.405082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:37.900204 run create_hlr_db(pid=26098): Launched 16:47:38.029324 bus /gobi_6: Setting Powered False 16:47:39.093201 run create_hlr_db(pid=26098): Terminated: ok {rc=0} 16:47:39.519939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26100): Launched 16:47:39.819488 run osmo-hlr_10.42.42.2(pid=26101): Launched 16:47:39.932936 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:40.452016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26103): Launched 16:47:40.752695 run osmo-stp_10.42.42.5(pid=26104): Launched 16:47:40.865780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:41.381205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26106): Launched 16:47:41.495669 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:41.749057 run patchelf(pid=26107): Launched 16:47:41.915294 run osmo-stp_10.42.42.5(pid=26104): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26104)] 16:47:42.041843 run osmo-stp_10.42.42.5(pid=26104): stdout: | (launched: 2022-12-10_16:47:40.697049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:42.170506 run osmo-stp_10.42.42.5(pid=26104): stderr: | [0;m[38;5;43m20221210164740864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164740864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164740864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164740864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164740865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164740865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164740865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:42.299154 run osmo-stp_10.42.42.5(pid=26104): stdout: | (launched: 2022-12-10_16:47:40.697049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:42.421443 run osmo-stp_10.42.42.5(pid=26104): stderr: | [0;m[38;5;43m20221210164740864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164740864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164740864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164740864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164740865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164740865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164740865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:42.566815 run patchelf(pid=26107): Terminating (SIGINT) 16:47:42.735167 run patchelf(pid=26107): Terminated: ok {rc=0} 16:47:42.856441 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26104): Process ended prematurely: osmo-stp_10.42.42.5(pid=26104) [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26104)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 16:47:42.865947 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:47:42.894215 run osmo-hlr_10.42.42.2(pid=26101): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26101)] 16:47:42.942283 run osmo-hlr_10.42.42.2(pid=26101): stdout: | (launched: 2022-12-10_16:47:39.763674) 16:47:42.991886 run osmo-hlr_10.42.42.2(pid=26101): stderr: | [0;m[1;31m20221210164739937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164739937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164739937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164739937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164739937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164739937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164739949 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164739958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164739958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164739958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:43.042021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26088): Terminating (SIGTERM) 16:47:43.082540 run iperf3-srv_10.42.42.10(pid=26089): Terminating (SIGTERM) 16:47:43.122858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26090): Terminating (SIGTERM) 16:47:43.163206 run iperf3-srv_10.42.42.10(pid=26091): Terminating (SIGTERM) 16:47:43.203450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26092): Terminating (SIGTERM) 16:47:43.243725 run iperf3-srv_10.42.42.10(pid=26095): Terminating (SIGTERM) 16:47:43.283562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26096): Terminating (SIGTERM) 16:47:43.323834 run iperf3-srv_10.42.42.10(pid=26097): Terminating (SIGTERM) 16:47:43.365439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26100): Terminating (SIGTERM) 16:47:43.410508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26103): Terminating (SIGTERM) 16:47:43.453496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26106): Terminating (SIGTERM) 16:47:43.496682 --- ParallelTerminationStrategy: PID 26088 died... 16:47:43.517078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26088): Terminated: ok {rc=0} 16:47:43.565006 --- ParallelTerminationStrategy: PID 26089 died... 16:47:43.584874 run iperf3-srv_10.42.42.10(pid=26089): Terminated {rc=256} 16:47:43.632128 --- ParallelTerminationStrategy: PID 26090 died... 16:47:43.651893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26090): Terminated: ok {rc=0} 16:47:43.700313 --- ParallelTerminationStrategy: PID 26091 died... 16:47:43.720104 run iperf3-srv_10.42.42.10(pid=26091): Terminated {rc=256} 16:47:43.767536 --- ParallelTerminationStrategy: PID 26092 died... 16:47:43.787218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26092): Terminated: ok {rc=0} 16:47:43.834899 --- ParallelTerminationStrategy: PID 26095 died... 16:47:43.854667 run iperf3-srv_10.42.42.10(pid=26095): Terminated {rc=256} 16:47:43.901937 --- ParallelTerminationStrategy: PID 26096 died... 16:47:43.921587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26096): Terminated: ok {rc=0} 16:47:43.969157 --- ParallelTerminationStrategy: PID 26097 died... 16:47:43.988913 run iperf3-srv_10.42.42.10(pid=26097): Terminated {rc=256} 16:47:44.036350 --- ParallelTerminationStrategy: PID 26100 died... 16:47:44.055908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26100): Terminated: ok {rc=0} 16:47:44.103105 --- ParallelTerminationStrategy: PID 26103 died... 16:47:44.122823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26103): Terminated: ok {rc=0} 16:47:44.170192 --- ParallelTerminationStrategy: PID 26106 died... 16:47:44.190088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26106): Terminated: ok {rc=0} 16:47:44.279445 bus /gobi_4: Setting Powered False 16:47:45.379571 bus /gobi_4: Setting Powered False 16:47:46.498386 bus /gobi_1: Setting Powered False 16:47:47.598728 bus /gobi_1: Setting Powered False 16:47:48.717404 bus /gobi_0: Setting Powered False 16:47:49.816559 bus /gobi_0: Setting Powered False 16:47:50.933298 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 16:47:52.036837 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.048377 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:52.103500 tst ping.py: using LAC 29307 16:47:52.218863 tst ping.py: using RAC 237 16:47:52.332727 tst ping.py: using CellId 29307 16:47:52.447807 tst ping.py: using BVCI 29308 16:47:52.554819 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.565884 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.576703 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.587725 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.598620 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.609740 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.620929 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.631914 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:52.748475 tst ping.py:19: start network... 16:47:52.944557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:53.397677 run create_hlr_db(pid=26108): Launched 16:47:53.508559 bus /gobi_6: Setting Powered False 16:47:54.568189 run create_hlr_db(pid=26108): Terminated: ok {rc=0} 16:47:54.999593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26110): Launched 16:47:55.313059 run osmo-hlr_10.42.42.2(pid=26111): Launched 16:47:55.433055 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:55.980631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26113): Launched 16:47:56.294114 run osmo-stp_10.42.42.5(pid=26114): Launched 16:47:56.413988 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:56.959620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26116): Launched 16:47:57.079835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:57.345644 run patchelf(pid=26117): Launched 16:47:57.520243 run osmo-stp_10.42.42.5(pid=26114): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26114)] 16:47:57.653648 run osmo-stp_10.42.42.5(pid=26114): stdout: | (launched: 2022-12-10_16:47:56.236528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:57.789025 run osmo-stp_10.42.42.5(pid=26114): stderr: | [0;m[38;5;43m20221210164756428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164756428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164756429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164756429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164756430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164756430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164756430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:57.923848 run osmo-stp_10.42.42.5(pid=26114): stdout: | (launched: 2022-12-10_16:47:56.236528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:58.052612 run osmo-stp_10.42.42.5(pid=26114): stderr: | [0;m[38;5;43m20221210164756428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164756428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164756429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164756429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164756430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164756430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164756430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:58.205534 run patchelf(pid=26117): Terminating (SIGINT) 16:47:58.382190 run patchelf(pid=26117): Terminated: ok {rc=0} 16:47:58.509061 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26114): Process ended prematurely: osmo-stp_10.42.42.5(pid=26114) [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26114)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 16:47:58.518531 tst ping.py:22: Test FAILED (6.5 sec) 16:47:58.546863 run osmo-hlr_10.42.42.2(pid=26111): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26111)] 16:47:58.596936 run osmo-hlr_10.42.42.2(pid=26111): stdout: | (launched: 2022-12-10_16:47:55.255420) 16:47:58.648446 run osmo-hlr_10.42.42.2(pid=26111): stderr: | [0;m[1;31m20221210164755450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164755450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164755450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164755451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164755451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164755451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164755463 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164755471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164755472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164755472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:58.700578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26110): Terminating (SIGTERM) 16:47:58.742673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26113): Terminating (SIGTERM) 16:47:58.785007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26116): Terminating (SIGTERM) 16:47:58.827139 --- ParallelTerminationStrategy: PID 26110 died... 16:47:58.847310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26110): Terminated: ok {rc=0} 16:47:58.894146 --- ParallelTerminationStrategy: PID 26113 died... 16:47:58.913997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26113): Terminated: ok {rc=0} 16:47:58.960702 --- ParallelTerminationStrategy: PID 26116 died... 16:47:58.980480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26116): Terminated: ok {rc=0} 16:47:59.068762 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:48:00.156734 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.169418 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:48:00.221371 tst ping_idle_ping.py: using LAC 29308 16:48:00.346295 tst ping_idle_ping.py: using RAC 238 16:48:00.470604 tst ping_idle_ping.py: using CellId 29308 16:48:00.593724 tst ping_idle_ping.py: using BVCI 29309 16:48:00.708004 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.719478 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.730706 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.741939 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.753192 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.764314 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.775782 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.787200 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:48:00.926268 tst ping_idle_ping.py:24: start network... 16:48:01.199960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:01.723869 run create_hlr_db(pid=26118): Launched 16:48:01.891702 bus /gobi_6: Setting Powered False 16:48:02.953909 run create_hlr_db(pid=26118): Terminated: ok {rc=0} 16:48:03.411345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26120): Launched 16:48:03.725203 run osmo-hlr_10.42.42.2(pid=26121): Launched 16:48:03.844516 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:04.383100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26123): Launched 16:48:04.696703 run osmo-stp_10.42.42.5(pid=26124): Launched 16:48:04.817299 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:05.360583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26126): Launched 16:48:05.479983 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:05.745115 run patchelf(pid=26127): Launched 16:48:05.919389 run osmo-stp_10.42.42.5(pid=26124): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26124)] 16:48:06.052030 run osmo-stp_10.42.42.5(pid=26124): stdout: | (launched: 2022-12-10_16:48:04.639141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:06.186730 run osmo-stp_10.42.42.5(pid=26124): stderr: | [0;m[38;5;43m20221210164804830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164804831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164804831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164804831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164804832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164804832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164804832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:06.321399 run osmo-stp_10.42.42.5(pid=26124): stdout: | (launched: 2022-12-10_16:48:04.639141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:06.450165 run osmo-stp_10.42.42.5(pid=26124): stderr: | [0;m[38;5;43m20221210164804830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164804831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164804831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164804831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164804832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164804832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164804832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:06.602628 run patchelf(pid=26127): Terminating (SIGINT) 16:48:06.779753 run patchelf(pid=26127): Terminated: ok {rc=0} 16:48:06.907657 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26124): Process ended prematurely: osmo-stp_10.42.42.5(pid=26124) [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26124)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 16:48:06.917342 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:48:06.945518 run osmo-hlr_10.42.42.2(pid=26121): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26121)] 16:48:06.995572 run osmo-hlr_10.42.42.2(pid=26121): stdout: | (launched: 2022-12-10_16:48:03.667154) 16:48:07.047207 run osmo-hlr_10.42.42.2(pid=26121): stderr: | [0;m[1;31m20221210164803865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164803865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164803865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164803865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164803865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164803865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164803877 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164803886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164803886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164803886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:07.099271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26120): Terminating (SIGTERM) 16:48:07.140890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26123): Terminating (SIGTERM) 16:48:07.182629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26126): Terminating (SIGTERM) 16:48:07.224658 --- ParallelTerminationStrategy: PID 26120 died... 16:48:07.244455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26120): Terminated: ok {rc=0} 16:48:07.290725 --- ParallelTerminationStrategy: PID 26123 died... 16:48:07.310562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26123): Terminated: ok {rc=0} 16:48:07.356552 --- ParallelTerminationStrategy: PID 26126 died... 16:48:07.376202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26126): Terminated: ok {rc=0} 16:48:07.463296 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:48:08.763539 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:48:08.770389 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:48:08.803745 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:48:08.842746 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:48:08.929134 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:48:08.962219 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:48:09.001456 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:48:09.598004 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:48:09.649517 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:09.661096 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:09.728874 tst cs_paging_gprs_active.py: using LAC 29309 16:48:09.846810 tst cs_paging_gprs_active.py: using RAC 239 16:48:09.966354 tst cs_paging_gprs_active.py: using CellId 29309 16:48:10.086615 tst cs_paging_gprs_active.py: using BVCI 29310 16:48:10.194867 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.206009 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.217332 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.228555 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.239789 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.251101 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.262530 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.273850 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.285658 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:10.403949 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:10.522975 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:48:10.739470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:11.060591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26131): Launched 16:48:11.337563 run iperf3-srv_10.42.42.10(pid=26132): Launched 16:48:11.457300 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:48:11.673970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:11.995905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26133): Launched 16:48:12.273497 run iperf3-srv_10.42.42.10(pid=26134): Launched 16:48:12.393138 tst cs_paging_gprs_active.py:38: start network... 16:48:12.610084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:13.105687 run create_hlr_db(pid=26135): Launched 16:48:13.235323 bus /gobi_6: Setting Powered False 16:48:14.298806 run create_hlr_db(pid=26135): Terminated: ok {rc=0} 16:48:14.725487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26137): Launched 16:48:15.026017 run osmo-hlr_10.42.42.2(pid=26138): Launched 16:48:15.140251 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:15.656891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26140): Launched 16:48:15.986322 run osmo-stp_10.42.42.5(pid=26141): Launched 16:48:16.262856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:16.991438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26143): Launched 16:48:17.129221 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:17.393256 run patchelf(pid=26144): Launched 16:48:17.559979 run osmo-stp_10.42.42.5(pid=26141): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26141)] 16:48:17.686494 run osmo-stp_10.42.42.5(pid=26141): stdout: | (launched: 2022-12-10_16:48:15.906151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:17.815378 run osmo-stp_10.42.42.5(pid=26141): stderr: | [0;m[38;5;43m20221210164816323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164816323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164816326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164816326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164816329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164816329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164816330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:17.944213 run osmo-stp_10.42.42.5(pid=26141): stdout: | (launched: 2022-12-10_16:48:15.906151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:18.067111 run osmo-stp_10.42.42.5(pid=26141): stderr: | [0;m[38;5;43m20221210164816323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164816323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164816326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164816326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164816329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164816329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164816330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:18.212727 run patchelf(pid=26144): Terminating (SIGINT) 16:48:18.381270 run patchelf(pid=26144): Terminated: ok {rc=0} 16:48:18.502737 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26141): Process ended prematurely: osmo-stp_10.42.42.5(pid=26141) [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26141)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:48:18.512023 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:48:18.539633 run osmo-hlr_10.42.42.2(pid=26138): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26138)] 16:48:18.587533 run osmo-hlr_10.42.42.2(pid=26138): stdout: | (launched: 2022-12-10_16:48:14.970914) 16:48:18.637267 run osmo-hlr_10.42.42.2(pid=26138): stderr: | [0;m[1;31m20221210164815143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164815143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164815143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164815143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164815143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164815144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164815159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164815169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164815169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164815169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:18.687247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26131): Terminating (SIGTERM) 16:48:18.727755 run iperf3-srv_10.42.42.10(pid=26132): Terminating (SIGTERM) 16:48:18.767612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26133): Terminating (SIGTERM) 16:48:18.807647 run iperf3-srv_10.42.42.10(pid=26134): Terminating (SIGTERM) 16:48:18.847419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26137): Terminating (SIGTERM) 16:48:18.887209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26140): Terminating (SIGTERM) 16:48:18.927197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26143): Terminating (SIGTERM) 16:48:18.967502 --- ParallelTerminationStrategy: PID 26131 died... 16:48:18.986760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26131): Terminated: ok {rc=0} 16:48:19.031392 --- ParallelTerminationStrategy: PID 26132 died... 16:48:19.050034 run iperf3-srv_10.42.42.10(pid=26132): Terminated {rc=256} 16:48:19.094083 --- ParallelTerminationStrategy: PID 26133 died... 16:48:19.112537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26133): Terminated: ok {rc=0} 16:48:19.156885 --- ParallelTerminationStrategy: PID 26134 died... 16:48:19.175534 run iperf3-srv_10.42.42.10(pid=26134): Terminated {rc=256} 16:48:19.219583 --- ParallelTerminationStrategy: PID 26137 died... 16:48:19.238269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26137): Terminated: ok {rc=0} 16:48:19.282482 --- ParallelTerminationStrategy: PID 26140 died... 16:48:19.301257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26140): Terminated: ok {rc=0} 16:48:19.345628 --- ParallelTerminationStrategy: PID 26143 died... 16:48:19.364353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26143): Terminated: ok {rc=0} 16:48:19.449464 bus /gobi_0: Setting Powered False 16:48:20.548570 bus /gobi_0: Setting Powered False 16:48:21.663972 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:48:22.810085 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:22.821752 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:22.890441 tst iperf3.py: using LAC 29310 16:48:23.008904 tst iperf3.py: using RAC 240 16:48:23.127916 tst iperf3.py: using CellId 29310 16:48:23.255858 tst iperf3.py: using BVCI 29311 16:48:23.372611 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.384421 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.395771 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.407637 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.419519 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.431264 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.443006 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.454638 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.466483 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:23.583542 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:48:23.801484 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:24.124273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26145): Launched 16:48:24.404298 run iperf3-srv_10.42.42.10(pid=26146): Launched 16:48:24.524791 tst iperf3.py:8: start network... 16:48:24.742165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:25.239948 run create_hlr_db(pid=26147): Launched 16:48:25.369513 bus /gobi_6: Setting Powered False 16:48:26.433186 run create_hlr_db(pid=26147): Terminated: ok {rc=0} 16:48:26.862155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26149): Launched 16:48:27.161785 run osmo-hlr_10.42.42.2(pid=26150): Launched 16:48:27.275132 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:27.791094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26152): Launched 16:48:28.090022 run osmo-stp_10.42.42.5(pid=26153): Launched 16:48:28.202959 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:28.717493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26155): Launched 16:48:28.832780 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:29.086033 run patchelf(pid=26156): Launched 16:48:29.251929 run osmo-stp_10.42.42.5(pid=26153): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26153)] 16:48:29.378562 run osmo-stp_10.42.42.5(pid=26153): stdout: | (launched: 2022-12-10_16:48:28.035098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:29.507049 run osmo-stp_10.42.42.5(pid=26153): stderr: | [0;m[38;5;43m20221210164828202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164828202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164828203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164828203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164828203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164828204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164828204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:29.635673 run osmo-stp_10.42.42.5(pid=26153): stdout: | (launched: 2022-12-10_16:48:28.035098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:29.758200 run osmo-stp_10.42.42.5(pid=26153): stderr: | [0;m[38;5;43m20221210164828202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164828202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164828203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164828203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164828203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164828204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164828204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:29.903120 run patchelf(pid=26156): Terminating (SIGINT) 16:48:30.071945 run patchelf(pid=26156): Terminated: ok {rc=0} 16:48:30.193779 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26153): Process ended prematurely: osmo-stp_10.42.42.5(pid=26153) [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26153)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 16:48:30.203096 tst iperf3.py:8: Test FAILED (7.4 sec) 16:48:30.230685 run osmo-hlr_10.42.42.2(pid=26150): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26150)] 16:48:30.278671 run osmo-hlr_10.42.42.2(pid=26150): stdout: | (launched: 2022-12-10_16:48:27.106739) 16:48:30.328234 run osmo-hlr_10.42.42.2(pid=26150): stderr: | [0;m[1;31m20221210164827282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164827282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164827282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164827282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164827282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164827282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164827295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164827304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164827304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164827304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:30.378497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26145): Terminating (SIGTERM) 16:48:30.418485 run iperf3-srv_10.42.42.10(pid=26146): Terminating (SIGTERM) 16:48:30.458160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26149): Terminating (SIGTERM) 16:48:30.497896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26152): Terminating (SIGTERM) 16:48:30.537694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26155): Terminating (SIGTERM) 16:48:30.577819 --- ParallelTerminationStrategy: PID 26145 died... 16:48:30.597020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26145): Terminated: ok {rc=0} 16:48:30.641663 --- ParallelTerminationStrategy: PID 26146 died... 16:48:30.660253 run iperf3-srv_10.42.42.10(pid=26146): Terminated {rc=256} 16:48:30.704502 --- ParallelTerminationStrategy: PID 26149 died... 16:48:30.723225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26149): Terminated: ok {rc=0} 16:48:30.767803 --- ParallelTerminationStrategy: PID 26152 died... 16:48:30.786514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26152): Terminated: ok {rc=0} 16:48:30.831129 --- ParallelTerminationStrategy: PID 26155 died... 16:48:30.850540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26155): Terminated: ok {rc=0} 16:48:30.949363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:48:32.128655 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.146486 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:32.236091 tst iperf3m4.py: using LAC 29311 16:48:32.369300 tst iperf3m4.py: using RAC 241 16:48:32.495899 tst iperf3m4.py: using CellId 29311 16:48:32.621524 tst iperf3m4.py: using BVCI 29312 16:48:32.739943 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.751675 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.763394 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.775559 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.787584 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.799488 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.811959 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.823859 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.835879 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:32.953816 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:33.075601 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:33.194500 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:33.310818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:48:33.513063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:33.816041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26157): Launched 16:48:34.078063 run iperf3-srv_10.42.42.10(pid=26158): Launched 16:48:34.190882 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:48:34.392394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:34.694066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26159): Launched 16:48:34.955233 run iperf3-srv_10.42.42.10(pid=26160): Launched 16:48:35.068383 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:48:35.269618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:35.571396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26161): Launched 16:48:35.833610 run iperf3-srv_10.42.42.10(pid=26162): Launched 16:48:35.946245 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:48:36.148811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:36.450729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26163): Launched 16:48:36.711548 run iperf3-srv_10.42.42.10(pid=26164): Launched 16:48:36.823814 tst iperf3m4.py:8: start network... 16:48:37.024099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:37.488422 run create_hlr_db(pid=26165): Launched 16:48:37.620153 bus /gobi_6: Setting Powered False 16:48:38.684428 run create_hlr_db(pid=26165): Terminated: ok {rc=0} 16:48:39.131070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26168): Launched 16:48:39.450051 run osmo-hlr_10.42.42.2(pid=26169): Launched 16:48:39.570424 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:40.127036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26171): Launched 16:48:40.447704 run osmo-stp_10.42.42.5(pid=26172): Launched 16:48:40.569733 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:41.122852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26174): Launched 16:48:41.245273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:41.515672 run patchelf(pid=26175): Launched 16:48:41.693237 run osmo-stp_10.42.42.5(pid=26172): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26172)] 16:48:41.828825 run osmo-stp_10.42.42.5(pid=26172): stdout: | (launched: 2022-12-10_16:48:40.389100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:41.966159 run osmo-stp_10.42.42.5(pid=26172): stderr: | [0;m[38;5;43m20221210164840575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164840575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164840575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164840576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164840576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164840576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164840577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:42.103061 run osmo-stp_10.42.42.5(pid=26172): stdout: | (launched: 2022-12-10_16:48:40.389100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:42.233448 run osmo-stp_10.42.42.5(pid=26172): stderr: | [0;m[38;5;43m20221210164840575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164840575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164840575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164840576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164840576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164840576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164840577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:42.388587 run patchelf(pid=26175): Terminating (SIGINT) 16:48:42.568259 run patchelf(pid=26175): Terminated: ok {rc=0} 16:48:42.697772 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26172): Process ended prematurely: osmo-stp_10.42.42.5(pid=26172) [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26172)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:48:42.707838 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:48:42.736752 run osmo-hlr_10.42.42.2(pid=26169): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26169)] 16:48:42.786227 run osmo-hlr_10.42.42.2(pid=26169): stdout: | (launched: 2022-12-10_16:48:39.391752) 16:48:42.837312 run osmo-hlr_10.42.42.2(pid=26169): stderr: | [0;m[1;31m20221210164839586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164839586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164839586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164839586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164839586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164839586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164839598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164839607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164839607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164839607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:42.889264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26157): Terminating (SIGTERM) 16:48:42.930613 run iperf3-srv_10.42.42.10(pid=26158): Terminating (SIGTERM) 16:48:42.971882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26159): Terminating (SIGTERM) 16:48:43.013443 run iperf3-srv_10.42.42.10(pid=26160): Terminating (SIGTERM) 16:48:43.054758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26161): Terminating (SIGTERM) 16:48:43.096078 run iperf3-srv_10.42.42.10(pid=26162): Terminating (SIGTERM) 16:48:43.138076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26163): Terminating (SIGTERM) 16:48:43.179589 run iperf3-srv_10.42.42.10(pid=26164): Terminating (SIGTERM) 16:48:43.221019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26168): Terminating (SIGTERM) 16:48:43.262481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26171): Terminating (SIGTERM) 16:48:43.304071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26174): Terminating (SIGTERM) 16:48:43.346348 --- ParallelTerminationStrategy: PID 26157 died... 16:48:43.366470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26157): Terminated: ok {rc=0} 16:48:43.413169 --- ParallelTerminationStrategy: PID 26158 died... 16:48:43.432615 run iperf3-srv_10.42.42.10(pid=26158): Terminated {rc=256} 16:48:43.478730 --- ParallelTerminationStrategy: PID 26159 died... 16:48:43.498438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26159): Terminated: ok {rc=0} 16:48:43.544658 --- ParallelTerminationStrategy: PID 26160 died... 16:48:43.564349 run iperf3-srv_10.42.42.10(pid=26160): Terminated {rc=256} 16:48:43.610314 --- ParallelTerminationStrategy: PID 26161 died... 16:48:43.630034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26161): Terminated: ok {rc=0} 16:48:43.676312 --- ParallelTerminationStrategy: PID 26162 died... 16:48:43.695965 run iperf3-srv_10.42.42.10(pid=26162): Terminated {rc=256} 16:48:43.742756 --- ParallelTerminationStrategy: PID 26163 died... 16:48:43.762653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26163): Terminated: ok {rc=0} 16:48:43.809196 --- ParallelTerminationStrategy: PID 26164 died... 16:48:43.828740 run iperf3-srv_10.42.42.10(pid=26164): Terminated {rc=256} 16:48:43.874869 --- ParallelTerminationStrategy: PID 26168 died... 16:48:43.894517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26168): Terminated: ok {rc=0} 16:48:43.940376 --- ParallelTerminationStrategy: PID 26171 died... 16:48:43.960116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26171): Terminated: ok {rc=0} 16:48:44.006249 --- ParallelTerminationStrategy: PID 26174 died... 16:48:44.026085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26174): Terminated: ok {rc=0} 16:48:44.114286 bus /gobi_4: Setting Powered False 16:48:45.214408 bus /gobi_4: Setting Powered False 16:48:46.328399 bus /gobi_1: Setting Powered False 16:48:47.427845 bus /gobi_1: Setting Powered False 16:48:48.543897 bus /gobi_0: Setting Powered False 16:48:49.641894 bus /gobi_0: Setting Powered False 16:48:50.758588 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:48:51.860782 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:51.872877 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:51.941667 tst ping.py: using LAC 29312 16:48:52.059603 tst ping.py: using RAC 242 16:48:52.177072 tst ping.py: using CellId 29312 16:48:52.293620 tst ping.py: using BVCI 29313 16:48:52.408777 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.420523 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.432041 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.443279 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.454791 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.466354 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.477737 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.488833 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:52.605347 tst ping.py:19: start network... 16:48:52.818798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:53.305586 run create_hlr_db(pid=26176): Launched 16:48:53.433356 bus /gobi_6: Setting Powered False 16:48:54.496558 run create_hlr_db(pid=26176): Terminated: ok {rc=0} 16:48:54.918769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26178): Launched 16:48:55.213977 run osmo-hlr_10.42.42.2(pid=26179): Launched 16:48:55.326128 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:55.849146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26181): Launched 16:48:56.142576 run osmo-stp_10.42.42.5(pid=26182): Launched 16:48:56.253496 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:56.760007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26184): Launched 16:48:56.872096 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:57.120839 run patchelf(pid=26185): Launched 16:48:57.284926 run osmo-stp_10.42.42.5(pid=26182): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26182)] 16:48:57.409830 run osmo-stp_10.42.42.5(pid=26182): stdout: | (launched: 2022-12-10_16:48:56.088429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:57.536350 run osmo-stp_10.42.42.5(pid=26182): stderr: | [0;m[38;5;43m20221210164856256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164856256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164856257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164856257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164856258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164856258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164856258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:57.663048 run osmo-stp_10.42.42.5(pid=26182): stdout: | (launched: 2022-12-10_16:48:56.088429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:57.783532 run osmo-stp_10.42.42.5(pid=26182): stderr: | [0;m[38;5;43m20221210164856256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164856256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164856257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164856257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164856258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164856258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164856258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:57.926505 run patchelf(pid=26185): Terminating (SIGINT) 16:48:58.092727 run patchelf(pid=26185): Terminated: ok {rc=0} 16:48:58.212522 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26182): Process ended prematurely: osmo-stp_10.42.42.5(pid=26182) [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26182)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 16:48:58.221338 tst ping.py:22: Test FAILED (6.4 sec) 16:48:58.248757 run osmo-hlr_10.42.42.2(pid=26179): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26179)] 16:48:58.296610 run osmo-hlr_10.42.42.2(pid=26179): stdout: | (launched: 2022-12-10_16:48:55.159309) 16:48:58.346583 run osmo-hlr_10.42.42.2(pid=26179): stderr: | [0;m[1;31m20221210164855334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164855334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164855334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164855334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164855334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164855334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164855346 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164855355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164855355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164855355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:58.396774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26178): Terminating (SIGTERM) 16:48:58.436822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26181): Terminating (SIGTERM) 16:48:58.476893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26184): Terminating (SIGTERM) 16:48:58.517459 --- ParallelTerminationStrategy: PID 26178 died... 16:48:58.536712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26178): Terminated: ok {rc=0} 16:48:58.581911 --- ParallelTerminationStrategy: PID 26181 died... 16:48:58.600634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26181): Terminated: ok {rc=0} 16:48:58.646130 --- ParallelTerminationStrategy: PID 26184 died... 16:48:58.665166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26184): Terminated: ok {rc=0} 16:48:58.749307 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:48:59.833628 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:59.845287 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:59.912402 tst ping_idle_ping.py: using LAC 29313 16:49:00.027442 tst ping_idle_ping.py: using RAC 243 16:49:00.142965 tst ping_idle_ping.py: using CellId 29313 16:49:00.259541 tst ping_idle_ping.py: using BVCI 29314 16:49:00.366185 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.377354 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.388226 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.399486 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.410914 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.422130 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.433389 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.444619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:49:00.561940 tst ping_idle_ping.py:24: start network... 16:49:00.775635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:01.302514 run create_hlr_db(pid=26186): Launched 16:49:01.437316 bus /gobi_6: Setting Powered False 16:49:02.497094 run create_hlr_db(pid=26186): Terminated: ok {rc=0} 16:49:02.910071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26188): Launched 16:49:03.203835 run osmo-hlr_10.42.42.2(pid=26189): Launched 16:49:03.316614 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:03.839301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26191): Launched 16:49:04.133033 run osmo-stp_10.42.42.5(pid=26192): Launched 16:49:04.245864 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:04.769334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26194): Launched 16:49:04.881898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:05.130989 run patchelf(pid=26195): Launched 16:49:05.295297 run osmo-stp_10.42.42.5(pid=26192): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26192)] 16:49:05.420471 run osmo-stp_10.42.42.5(pid=26192): stdout: | (launched: 2022-12-10_16:49:04.078332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:05.546741 run osmo-stp_10.42.42.5(pid=26192): stderr: | [0;m[38;5;43m20221210164904247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164904247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164904247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164904248 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164904248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164904248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164904248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:05.673307 run osmo-stp_10.42.42.5(pid=26192): stdout: | (launched: 2022-12-10_16:49:04.078332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:05.794107 run osmo-stp_10.42.42.5(pid=26192): stderr: | [0;m[38;5;43m20221210164904247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164904247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164904247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164904248 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164904248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164904248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164904248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:05.937686 run patchelf(pid=26195): Terminating (SIGINT) 16:49:06.103117 run patchelf(pid=26195): Terminated: ok {rc=0} 16:49:06.222783 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26192): Process ended prematurely: osmo-stp_10.42.42.5(pid=26192) [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26192)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:49:06.231598 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:49:06.258707 run osmo-hlr_10.42.42.2(pid=26189): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26189)] 16:49:06.306534 run osmo-hlr_10.42.42.2(pid=26189): stdout: | (launched: 2022-12-10_16:49:03.149594) 16:49:06.356142 run osmo-hlr_10.42.42.2(pid=26189): stderr: | [0;m[1;31m20221210164903326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164903326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164903326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164903326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164903326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164903326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164903339 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164903347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164903347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164903348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:06.405845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26188): Terminating (SIGTERM) 16:49:06.445602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26191): Terminating (SIGTERM) 16:49:06.485369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26194): Terminating (SIGTERM) 16:49:06.525967 --- ParallelTerminationStrategy: PID 26188 died... 16:49:06.545060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26188): Terminated: ok {rc=0} 16:49:06.589778 --- ParallelTerminationStrategy: PID 26191 died... 16:49:06.608432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26191): Terminated: ok {rc=0} 16:49:06.653466 --- ParallelTerminationStrategy: PID 26194 died... 16:49:06.672032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26194): Terminated: ok {rc=0} 16:49:06.757622 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:49:08.073685 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:49:08.081603 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:49:08.115899 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:49:08.155739 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:49:08.244332 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:49:08.277290 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:49:08.316550 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:49:08.917798 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:49:08.969701 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:08.981627 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:49:09.033253 tst cs_paging_gprs_active.py: using LAC 29314 16:49:09.157869 tst cs_paging_gprs_active.py: using RAC 244 16:49:09.283379 tst cs_paging_gprs_active.py: using CellId 29314 16:49:09.411729 tst cs_paging_gprs_active.py: using BVCI 29315 16:49:09.529127 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:09.540833 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:09.552429 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:09.563991 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:09.575466 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:09.586942 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:09.599107 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:09.610739 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:09.622464 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:09.740063 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:09.852929 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:49:10.054125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:10.353411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26200): Launched 16:49:10.612748 run iperf3-srv_10.42.42.10(pid=26201): Launched 16:49:10.723738 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:49:10.922804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:11.221169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26202): Launched 16:49:11.497975 run iperf3-srv_10.42.42.10(pid=26203): Launched 16:49:11.616614 tst cs_paging_gprs_active.py:38: start network... 16:49:11.831729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:12.324323 run create_hlr_db(pid=26204): Launched 16:49:12.452158 bus /gobi_6: Setting Powered False 16:49:13.515817 run create_hlr_db(pid=26204): Terminated: ok {rc=0} 16:49:13.958644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26206): Launched 16:49:14.274118 run osmo-hlr_10.42.42.2(pid=26207): Launched 16:49:14.390078 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:14.911586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26209): Launched 16:49:15.208305 run osmo-stp_10.42.42.5(pid=26210): Launched 16:49:15.320723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:15.840934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26212): Launched 16:49:15.986382 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:16.264453 run patchelf(pid=26213): Launched 16:49:16.442128 run osmo-stp_10.42.42.5(pid=26210): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26210)] 16:49:16.570421 run osmo-stp_10.42.42.5(pid=26210): stdout: | (launched: 2022-12-10_16:49:15.153891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:16.701964 run osmo-stp_10.42.42.5(pid=26210): stderr: | [0;m[38;5;43m20221210164915322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164915322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164915322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164915323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164915323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164915323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164915323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:16.863199 run osmo-stp_10.42.42.5(pid=26210): stdout: | (launched: 2022-12-10_16:49:15.153891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:17.015356 run osmo-stp_10.42.42.5(pid=26210): stderr: | [0;m[38;5;43m20221210164915322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164915322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164915322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164915323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164915323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164915323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164915323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:17.165312 run patchelf(pid=26213): Terminating (SIGINT) 16:49:17.337347 run patchelf(pid=26213): Terminated: ok {rc=0} 16:49:17.459608 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26210): Process ended prematurely: osmo-stp_10.42.42.5(pid=26210) [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26210)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:49:17.469533 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:49:17.498263 run osmo-hlr_10.42.42.2(pid=26207): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26207)] 16:49:17.546877 run osmo-hlr_10.42.42.2(pid=26207): stdout: | (launched: 2022-12-10_16:49:14.216882) 16:49:17.597479 run osmo-hlr_10.42.42.2(pid=26207): stderr: | [0;m[1;31m20221210164914398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164914398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164914398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164914398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164914398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164914398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164914410 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164914418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164914419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164914419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:17.647801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26200): Terminating (SIGTERM) 16:49:17.688559 run iperf3-srv_10.42.42.10(pid=26201): Terminating (SIGTERM) 16:49:17.729218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26202): Terminating (SIGTERM) 16:49:17.770270 run iperf3-srv_10.42.42.10(pid=26203): Terminating (SIGTERM) 16:49:17.810870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26206): Terminating (SIGTERM) 16:49:17.851785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26209): Terminating (SIGTERM) 16:49:17.892262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26212): Terminating (SIGTERM) 16:49:17.933285 --- ParallelTerminationStrategy: PID 26200 died... 16:49:17.952380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26200): Terminated: ok {rc=0} 16:49:17.997837 --- ParallelTerminationStrategy: PID 26201 died... 16:49:18.016413 run iperf3-srv_10.42.42.10(pid=26201): Terminated {rc=256} 16:49:18.061690 --- ParallelTerminationStrategy: PID 26202 died... 16:49:18.080340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26202): Terminated: ok {rc=0} 16:49:18.125758 --- ParallelTerminationStrategy: PID 26203 died... 16:49:18.144255 run iperf3-srv_10.42.42.10(pid=26203): Terminated {rc=256} 16:49:18.189454 --- ParallelTerminationStrategy: PID 26206 died... 16:49:18.208043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26206): Terminated: ok {rc=0} 16:49:18.253544 --- ParallelTerminationStrategy: PID 26209 died... 16:49:18.272096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26209): Terminated: ok {rc=0} 16:49:18.317629 --- ParallelTerminationStrategy: PID 26212 died... 16:49:18.336407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26212): Terminated: ok {rc=0} 16:49:18.425098 bus /gobi_0: Setting Powered False 16:49:19.523505 bus /gobi_0: Setting Powered False 16:49:20.638526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:49:21.786858 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:21.799691 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:49:21.851202 tst iperf3.py: using LAC 29315 16:49:21.975463 tst iperf3.py: using RAC 245 16:49:22.099076 tst iperf3.py: using CellId 29315 16:49:22.225196 tst iperf3.py: using BVCI 29316 16:49:22.339528 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:22.351459 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:22.363130 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:22.374922 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:22.386791 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:22.398720 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:22.410704 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:22.422451 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:22.434547 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:22.551610 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:49:22.750793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:23.047906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26214): Launched 16:49:23.304917 run iperf3-srv_10.42.42.10(pid=26215): Launched 16:49:23.415677 tst iperf3.py:8: start network... 16:49:23.614299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:24.072413 run create_hlr_db(pid=26216): Launched 16:49:24.185846 bus /gobi_6: Setting Powered False 16:49:25.245884 run create_hlr_db(pid=26216): Terminated: ok {rc=0} 16:49:25.661462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26218): Launched 16:49:25.959079 run osmo-hlr_10.42.42.2(pid=26219): Launched 16:49:26.071987 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:26.595325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26221): Launched 16:49:26.891353 run osmo-stp_10.42.42.5(pid=26222): Launched 16:49:27.005559 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:27.518137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26224): Launched 16:49:27.631183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:27.881172 run patchelf(pid=26225): Launched 16:49:28.045657 run osmo-stp_10.42.42.5(pid=26222): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26222)] 16:49:28.171503 run osmo-stp_10.42.42.5(pid=26222): stdout: | (launched: 2022-12-10_16:49:26.837068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:28.299065 run osmo-stp_10.42.42.5(pid=26222): stderr: | [0;m[38;5;43m20221210164927006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164927006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164927006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164927007 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164927007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164927007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164927007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:28.426721 run osmo-stp_10.42.42.5(pid=26222): stdout: | (launched: 2022-12-10_16:49:26.837068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:28.548440 run osmo-stp_10.42.42.5(pid=26222): stderr: | [0;m[38;5;43m20221210164927006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164927006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164927006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164927007 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164927007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164927007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164927007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:28.692882 run patchelf(pid=26225): Terminating (SIGINT) 16:49:28.859807 run patchelf(pid=26225): Terminated: ok {rc=0} 16:49:28.980176 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26222): Process ended prematurely: osmo-stp_10.42.42.5(pid=26222) [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26222)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:49:28.989748 tst iperf3.py:8: Test FAILED (7.2 sec) 16:49:29.017223 run osmo-hlr_10.42.42.2(pid=26219): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26219)] 16:49:29.064766 run osmo-hlr_10.42.42.2(pid=26219): stdout: | (launched: 2022-12-10_16:49:25.904846) 16:49:29.114284 run osmo-hlr_10.42.42.2(pid=26219): stderr: | [0;m[1;31m20221210164926082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164926082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164926082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164926082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164926082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164926082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164926094 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164926103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164926103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164926103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:29.163977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26214): Terminating (SIGTERM) 16:49:29.203871 run iperf3-srv_10.42.42.10(pid=26215): Terminating (SIGTERM) 16:49:29.243697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26218): Terminating (SIGTERM) 16:49:29.283367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26221): Terminating (SIGTERM) 16:49:29.323138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26224): Terminating (SIGTERM) 16:49:29.363039 --- ParallelTerminationStrategy: PID 26214 died... 16:49:29.381883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26214): Terminated: ok {rc=0} 16:49:29.426038 --- ParallelTerminationStrategy: PID 26215 died... 16:49:29.444426 run iperf3-srv_10.42.42.10(pid=26215): Terminated {rc=256} 16:49:29.488455 --- ParallelTerminationStrategy: PID 26218 died... 16:49:29.507041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26218): Terminated: ok {rc=0} 16:49:29.551093 --- ParallelTerminationStrategy: PID 26221 died... 16:49:29.569634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26221): Terminated: ok {rc=0} 16:49:29.613795 --- ParallelTerminationStrategy: PID 26224 died... 16:49:29.632352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26224): Terminated: ok {rc=0} 16:49:29.717404 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:49:30.866735 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:30.879634 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:49:30.941247 tst iperf3m4.py: using LAC 29316 16:49:31.076178 tst iperf3m4.py: using RAC 246 16:49:31.237969 tst iperf3m4.py: using CellId 29316 16:49:31.355074 tst iperf3m4.py: using BVCI 29317 16:49:31.502371 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.514767 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.528279 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.541826 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.555237 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.567421 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.581057 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.595638 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.609310 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:31.741033 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:31.888411 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:32.016138 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:32.145604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:49:32.401085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:32.702244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26226): Launched 16:49:32.960524 run iperf3-srv_10.42.42.10(pid=26227): Launched 16:49:33.071662 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:49:33.270140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:33.567905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26228): Launched 16:49:33.826655 run iperf3-srv_10.42.42.10(pid=26229): Launched 16:49:33.937949 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:49:34.136465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:34.433874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26230): Launched 16:49:34.691362 run iperf3-srv_10.42.42.10(pid=26231): Launched 16:49:34.802407 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:49:35.000401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:35.298220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26232): Launched 16:49:35.556596 run iperf3-srv_10.42.42.10(pid=26233): Launched 16:49:35.667432 tst iperf3m4.py:8: start network... 16:49:35.865936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:36.324636 run create_hlr_db(pid=26234): Launched 16:49:36.439423 bus /gobi_6: Setting Powered False 16:49:37.498943 run create_hlr_db(pid=26234): Terminated: ok {rc=0} 16:49:37.933705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26236): Launched 16:49:38.249732 run osmo-hlr_10.42.42.2(pid=26237): Launched 16:49:38.370133 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:38.919231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26239): Launched 16:49:39.236531 run osmo-stp_10.42.42.5(pid=26240): Launched 16:49:39.357724 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:39.906151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26242): Launched 16:49:40.027402 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:40.294786 run patchelf(pid=26243): Launched 16:49:40.470561 run osmo-stp_10.42.42.5(pid=26240): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26240)] 16:49:40.604679 run osmo-stp_10.42.42.5(pid=26240): stdout: | (launched: 2022-12-10_16:49:39.178325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:40.740836 run osmo-stp_10.42.42.5(pid=26240): stderr: | [0;m[38;5;43m20221210164939365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164939365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164939365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164939366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164939366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164939366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164939366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:40.877444 run osmo-stp_10.42.42.5(pid=26240): stdout: | (launched: 2022-12-10_16:49:39.178325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:41.007136 run osmo-stp_10.42.42.5(pid=26240): stderr: | [0;m[38;5;43m20221210164939365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164939365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164939365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164939366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164939366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164939366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164939366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:41.160828 run patchelf(pid=26243): Terminating (SIGINT) 16:49:41.338969 run patchelf(pid=26243): Terminated: ok {rc=0} 16:49:41.467291 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26240): Process ended prematurely: osmo-stp_10.42.42.5(pid=26240) [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26240)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:49:41.477288 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:49:41.505940 run osmo-hlr_10.42.42.2(pid=26237): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26237)] 16:49:41.555609 run osmo-hlr_10.42.42.2(pid=26237): stdout: | (launched: 2022-12-10_16:49:38.192238) 16:49:41.607124 run osmo-hlr_10.42.42.2(pid=26237): stderr: | [0;m[1;31m20221210164938384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164938384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164938384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164938384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164938384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164938385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164938397 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164938407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164938407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164938407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:41.659146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26226): Terminating (SIGTERM) 16:49:41.700731 run iperf3-srv_10.42.42.10(pid=26227): Terminating (SIGTERM) 16:49:41.742296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26228): Terminating (SIGTERM) 16:49:41.784270 run iperf3-srv_10.42.42.10(pid=26229): Terminating (SIGTERM) 16:49:41.826011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26230): Terminating (SIGTERM) 16:49:41.867774 run iperf3-srv_10.42.42.10(pid=26231): Terminating (SIGTERM) 16:49:41.910580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26232): Terminating (SIGTERM) 16:49:41.952415 run iperf3-srv_10.42.42.10(pid=26233): Terminating (SIGTERM) 16:49:41.993889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26236): Terminating (SIGTERM) 16:49:42.035474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26239): Terminating (SIGTERM) 16:49:42.076784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26242): Terminating (SIGTERM) 16:49:42.118775 --- ParallelTerminationStrategy: PID 26226 died... 16:49:42.138715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26226): Terminated: ok {rc=0} 16:49:42.184798 --- ParallelTerminationStrategy: PID 26227 died... 16:49:42.204575 run iperf3-srv_10.42.42.10(pid=26227): Terminated {rc=256} 16:49:42.250780 --- ParallelTerminationStrategy: PID 26228 died... 16:49:42.270484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26228): Terminated: ok {rc=0} 16:49:42.316456 --- ParallelTerminationStrategy: PID 26229 died... 16:49:42.335859 run iperf3-srv_10.42.42.10(pid=26229): Terminated {rc=256} 16:49:42.381689 --- ParallelTerminationStrategy: PID 26230 died... 16:49:42.401214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26230): Terminated: ok {rc=0} 16:49:42.447994 --- ParallelTerminationStrategy: PID 26231 died... 16:49:42.467549 run iperf3-srv_10.42.42.10(pid=26231): Terminated {rc=256} 16:49:42.513402 --- ParallelTerminationStrategy: PID 26232 died... 16:49:42.533248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26232): Terminated: ok {rc=0} 16:49:42.579273 --- ParallelTerminationStrategy: PID 26233 died... 16:49:42.598840 run iperf3-srv_10.42.42.10(pid=26233): Terminated {rc=256} 16:49:42.644656 --- ParallelTerminationStrategy: PID 26236 died... 16:49:42.664045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26236): Terminated: ok {rc=0} 16:49:42.709837 --- ParallelTerminationStrategy: PID 26239 died... 16:49:42.729241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26239): Terminated: ok {rc=0} 16:49:42.775373 --- ParallelTerminationStrategy: PID 26242 died... 16:49:42.795049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26242): Terminated: ok {rc=0} 16:49:42.882389 bus /gobi_4: Setting Powered False 16:49:43.981355 bus /gobi_4: Setting Powered False 16:49:45.097087 bus /gobi_1: Setting Powered False 16:49:46.197981 bus /gobi_1: Setting Powered False 16:49:47.329775 bus /gobi_0: Setting Powered False 16:49:48.427560 bus /gobi_0: Setting Powered False 16:49:49.543282 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:49:50.646621 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:50.658864 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:49:50.709403 tst ping.py: using LAC 29317 16:49:50.824209 tst ping.py: using RAC 247 16:49:50.938487 tst ping.py: using CellId 29317 16:49:51.054350 tst ping.py: using BVCI 29318 16:49:51.160145 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:51.171850 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:51.183014 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:51.194572 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:51.206168 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:51.217832 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:51.230011 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:51.241786 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:51.358486 tst ping.py:19: start network... 16:49:51.568348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:52.053223 run create_hlr_db(pid=26244): Launched 16:49:52.180146 bus /gobi_6: Setting Powered False 16:49:53.242882 run create_hlr_db(pid=26244): Terminated: ok {rc=0} 16:49:53.679569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26246): Launched 16:49:53.992297 run osmo-hlr_10.42.42.2(pid=26247): Launched 16:49:54.110233 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:54.652147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26249): Launched 16:49:54.964605 run osmo-stp_10.42.42.5(pid=26250): Launched 16:49:55.083050 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:55.620411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26252): Launched 16:49:55.739734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:56.003765 run patchelf(pid=26253): Launched 16:49:56.176639 run osmo-stp_10.42.42.5(pid=26250): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26250)] 16:49:56.308888 run osmo-stp_10.42.42.5(pid=26250): stdout: | (launched: 2022-12-10_16:49:54.907093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:56.442856 run osmo-stp_10.42.42.5(pid=26250): stderr: | [0;m[38;5;43m20221210164955097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164955097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164955097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164955098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164955098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164955098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164955098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:56.577172 run osmo-stp_10.42.42.5(pid=26250): stdout: | (launched: 2022-12-10_16:49:54.907093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:56.705028 run osmo-stp_10.42.42.5(pid=26250): stderr: | [0;m[38;5;43m20221210164955097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210164955097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210164955097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210164955098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210164955098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210164955098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210164955098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:56.857095 run patchelf(pid=26253): Terminating (SIGINT) 16:49:57.031842 run patchelf(pid=26253): Terminated: ok {rc=0} 16:49:57.157441 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26250): Process ended prematurely: osmo-stp_10.42.42.5(pid=26250) [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26250)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:49:57.166795 tst ping.py:22: Test FAILED (6.5 sec) 16:49:57.194678 run osmo-hlr_10.42.42.2(pid=26247): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26247)] 16:49:57.244165 run osmo-hlr_10.42.42.2(pid=26247): stdout: | (launched: 2022-12-10_16:49:53.935191) 16:49:57.295349 run osmo-hlr_10.42.42.2(pid=26247): stderr: | [0;m[1;31m20221210164954132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210164954132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210164954132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210164954132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210164954132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210164954132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210164954145 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210164954155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210164954155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210164954155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:57.347150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26246): Terminating (SIGTERM) 16:49:57.388605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26249): Terminating (SIGTERM) 16:49:57.430066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26252): Terminating (SIGTERM) 16:49:57.471741 --- ParallelTerminationStrategy: PID 26246 died... 16:49:57.491614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26246): Terminated: ok {rc=0} 16:49:57.537742 --- ParallelTerminationStrategy: PID 26249 died... 16:49:57.557148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26249): Terminated: ok {rc=0} 16:49:57.603118 --- ParallelTerminationStrategy: PID 26252 died... 16:49:57.622734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26252): Terminated: ok {rc=0} 16:49:57.711156 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:49:58.797918 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:58.810456 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:49:58.871651 tst ping_idle_ping.py: using LAC 29318 16:49:59.004687 tst ping_idle_ping.py: using RAC 248 16:49:59.129083 tst ping_idle_ping.py: using CellId 29318 16:49:59.255148 tst ping_idle_ping.py: using BVCI 29319 16:49:59.370103 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:59.382190 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:59.393902 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:59.405690 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:59.417360 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:59.429033 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:59.440816 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:59.452603 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:59.569541 tst ping_idle_ping.py:24: start network... 16:49:59.781582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:00.268471 run create_hlr_db(pid=26254): Launched 16:50:00.395150 bus /gobi_6: Setting Powered False 16:50:01.460698 run create_hlr_db(pid=26254): Terminated: ok {rc=0} 16:50:01.939838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26259): Launched 16:50:02.249406 run osmo-hlr_10.42.42.2(pid=26260): Launched 16:50:02.362736 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:02.880876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26262): Launched 16:50:03.173453 run osmo-stp_10.42.42.5(pid=26263): Launched 16:50:03.285142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:03.791612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26265): Launched 16:50:03.903037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:04.149845 run patchelf(pid=26266): Launched 16:50:04.312102 run osmo-stp_10.42.42.5(pid=26263): ERR: Terminated: ERROR {rc=1} [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26263)] 16:50:04.436239 run osmo-stp_10.42.42.5(pid=26263): stdout: | (launched: 2022-12-10_16:50:03.119375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:04.562081 run osmo-stp_10.42.42.5(pid=26263): stderr: | [0;m[38;5;43m20221210165003288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165003288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165003288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165003289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165003291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165003291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165003291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:04.688162 run osmo-stp_10.42.42.5(pid=26263): stdout: | (launched: 2022-12-10_16:50:03.119375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:04.808590 run osmo-stp_10.42.42.5(pid=26263): stderr: | [0;m[38;5;43m20221210165003288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165003288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165003288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165003289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165003291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165003291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165003291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:04.950903 run patchelf(pid=26266): Terminating (SIGINT) 16:50:05.115431 run patchelf(pid=26266): Terminated: ok {rc=0} 16:50:05.234467 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26263): Process ended prematurely: osmo-stp_10.42.42.5(pid=26263) [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26263)] [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:50:05.243565 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:50:05.271289 run osmo-hlr_10.42.42.2(pid=26260): ERR: Terminated: ERROR {rc=237} [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26260)] 16:50:05.319468 run osmo-hlr_10.42.42.2(pid=26260): stdout: | (launched: 2022-12-10_16:50:02.193779) 16:50:05.369272 run osmo-hlr_10.42.42.2(pid=26260): stderr: | [0;m[1;31m20221210165002369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165002369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165002369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165002369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165002369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165002369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165002381 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165002390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165002390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165002390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:05.419322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26259): Terminating (SIGTERM) 16:50:05.459565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26262): Terminating (SIGTERM) 16:50:05.499850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26265): Terminating (SIGTERM) 16:50:05.540414 --- ParallelTerminationStrategy: PID 26259 died... 16:50:05.559480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26259): Terminated: ok {rc=0} 16:50:05.604454 --- ParallelTerminationStrategy: PID 26262 died... 16:50:05.623208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26262): Terminated: ok {rc=0} 16:50:05.667922 --- ParallelTerminationStrategy: PID 26265 died... 16:50:05.686685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26265): Terminated: ok {rc=0} 16:50:05.773083 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 16:50:07.096631 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:50:07.105963 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:50:07.139261 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:50:07.173628 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:50:07.227114 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:50:07.260739 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:50:07.296132 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:50:07.854584 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2376 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:50:07.860636 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:07.872696 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:50:07.940275 tst switch_tch_pdch.py: using LAC 29319 16:50:08.053960 tst switch_tch_pdch.py: using RAC 249 16:50:08.178490 tst switch_tch_pdch.py: using CellId 29319 16:50:08.302730 tst switch_tch_pdch.py: using BVCI 29320 16:50:08.417330 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:08.429463 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:08.441463 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:08.453579 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:08.465358 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:08.477089 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:08.488897 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:08.500765 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:50:08.619339 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:50:08.739884 tst switch_tch_pdch.py:51: start network... 16:50:08.949958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:09.431347 run create_hlr_db(pid=26270): Launched 16:50:09.557116 bus /gobi_6: Setting Powered False 16:50:10.618851 run create_hlr_db(pid=26270): Terminated: ok {rc=0} 16:50:11.036488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26272): Launched 16:50:11.327753 run osmo-hlr_10.42.42.2(pid=26273): Launched 16:50:11.439070 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:11.950905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26275): Launched 16:50:12.242810 run osmo-stp_10.42.42.5(pid=26276): Launched 16:50:12.354720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:12.859234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26278): Launched 16:50:12.971304 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:13.218638 run patchelf(pid=26279): Launched 16:50:13.392164 run osmo-stp_10.42.42.5(pid=26276): ERR: Terminated: ERROR {rc=1} [trial-2376↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26276)] 16:50:13.524853 run osmo-stp_10.42.42.5(pid=26276): stdout: | (launched: 2022-12-10_16:50:12.189277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:13.659515 run osmo-stp_10.42.42.5(pid=26276): stderr: | [0;m[38;5;43m20221210165012356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165012356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165012356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165012356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165012357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165012357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165012357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:13.794480 run osmo-stp_10.42.42.5(pid=26276): stdout: | (launched: 2022-12-10_16:50:12.189277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:13.923508 run osmo-stp_10.42.42.5(pid=26276): stderr: | [0;m[38;5;43m20221210165012356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165012356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165012356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165012356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165012357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165012357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165012357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:14.075589 run patchelf(pid=26279): Terminating (SIGINT) 16:50:14.250387 run patchelf(pid=26279): Terminated: ok {rc=0} 16:50:14.376615 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26276): Process ended prematurely: osmo-stp_10.42.42.5(pid=26276) [trial-2376↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26276)] [trial-2376↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:50:14.386308 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:50:14.414209 run osmo-hlr_10.42.42.2(pid=26273): ERR: Terminated: ERROR {rc=237} [trial-2376↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26273)] 16:50:14.464369 run osmo-hlr_10.42.42.2(pid=26273): stdout: | (launched: 2022-12-10_16:50:11.274530) 16:50:14.516025 run osmo-hlr_10.42.42.2(pid=26273): stderr: | [0;m[1;31m20221210165011449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165011449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165011449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165011449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165011449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165011449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165011462 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165011470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165011470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165011470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:14.568394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26272): Terminating (SIGTERM) 16:50:14.610694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26275): Terminating (SIGTERM) 16:50:14.652844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26278): Terminating (SIGTERM) 16:50:14.695335 --- ParallelTerminationStrategy: PID 26272 died... 16:50:14.715582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26272): Terminated: ok {rc=0} 16:50:14.762267 --- ParallelTerminationStrategy: PID 26275 died... 16:50:14.782206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26275): Terminated: ok {rc=0} 16:50:14.828735 --- ParallelTerminationStrategy: PID 26278 died... 16:50:14.848474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26278): Terminated: ok {rc=0} 16:50:14.937560 bus /gobi_0: Setting Powered False 16:50:16.035284 bus /gobi_0: Setting Powered False 16:50:17.158503 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2376 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 nitb_smpp --------------------------------------------------------------------- 16:50:18.431674 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:50:18.439230 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 16:50:18.461473 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 16:50:18.469272 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 16:50:18.513955 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 16:50:18.548402 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 16:50:18.556220 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 16:50:19.052288 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2376 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 16:50:19.058620 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:50:19.079353 tst esme_connect_policy_acceptall.py: using MSISDN 7800 16:50:19.221194 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:50:19.818681 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26291): Launched 16:50:20.137458 run osmo-nitb_10.42.42.2(pid=26292): Launched 16:50:20.314045 run osmo-nitb_10.42.42.2(pid=26292): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26292)] 16:50:20.456894 run osmo-nitb_10.42.42.2(pid=26292): stdout: | (launched: 2022-12-10_16:50:20.079835) 16:50:20.601271 run osmo-nitb_10.42.42.2(pid=26292): stderr: | (launched: 2022-12-10_16:50:20.127237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:20.745684 run osmo-nitb_10.42.42.2(pid=26292): stdout: | (launched: 2022-12-10_16:50:20.079835) 16:50:20.884774 run osmo-nitb_10.42.42.2(pid=26292): stderr: | (launched: 2022-12-10_16:50:20.127237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26292): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26292) [trial-2376↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26292)] 16:50:21.258299 tst osmo-nitb_10.42.42.2(pid=26292): stdout: | (launched: 2022-12-10_16:50:20.079835) 16:50:21.388479 tst osmo-nitb_10.42.42.2(pid=26292): stderr: | (launched: 2022-12-10_16:50:20.127237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:21.541951 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=26292): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26292) [trial-2376↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26292)] [trial-2376↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 16:50:21.550733 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 16:50:21.557659 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26291): Terminating (SIGTERM) 16:50:21.769631 --- ParallelTerminationStrategy: PID 26291 died... 16:50:21.791083 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26291): Terminated: ok {rc=0} ---------------------------------------------- trial-2376 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 16:50:21.840150 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:50:21.862046 tst esme_connect_policy_closed.py: using MSISDN 7801 16:50:21.992504 tst esme_connect_policy_closed.py: using MSISDN 7802 16:50:22.108408 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:50:22.702358 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26293): Launched 16:50:23.022146 run osmo-nitb_10.42.42.2(pid=26294): Launched 16:50:23.193393 run osmo-nitb_10.42.42.2(pid=26294): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26294)] 16:50:23.324907 run osmo-nitb_10.42.42.2(pid=26294): stdout: | (launched: 2022-12-10_16:50:22.963984) 16:50:23.458064 run osmo-nitb_10.42.42.2(pid=26294): stderr: | (launched: 2022-12-10_16:50:23.011858) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:23.591413 run osmo-nitb_10.42.42.2(pid=26294): stdout: | (launched: 2022-12-10_16:50:22.963984) 16:50:23.718930 run osmo-nitb_10.42.42.2(pid=26294): stderr: | (launched: 2022-12-10_16:50:23.011858) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:23.871959 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=26294): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26294) [trial-2376↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26294)] [trial-2376↪nitb_smpp↪esme_connect_policy_closed.py:24] 16:50:23.880795 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 16:50:23.887576 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26293): Terminating (SIGTERM) 16:50:24.097691 --- ParallelTerminationStrategy: PID 26293 died... 16:50:24.119298 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26293): Terminated: ok {rc=0} ---------------------------------------------- trial-2376 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 16:50:24.169909 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:50:24.181363 tst nitb_smpp: Using 1 x bts (candidates: 1) 16:50:24.220933 tst esme_ms_sms_storeforward.py: using LAC 29320 16:50:24.347274 tst esme_ms_sms_storeforward.py: using RAC 250 16:50:24.471532 tst esme_ms_sms_storeforward.py: using CellId 29320 16:50:24.595933 tst esme_ms_sms_storeforward.py: using BVCI 29321 16:50:24.712139 tst nitb_smpp: Using 1 x modem (candidates: 1) 16:50:24.833660 tst esme_ms_sms_storeforward.py: using MSISDN 7803 16:50:24.942804 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 16:50:25.146227 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:50:25.762228 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26295): Launched 16:50:26.065167 run osmo-nitb_10.42.42.2(pid=26296): Launched 16:50:26.228397 run osmo-nitb_10.42.42.2(pid=26296): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26296)] 16:50:26.352683 run osmo-nitb_10.42.42.2(pid=26296): stdout: | (launched: 2022-12-10_16:50:26.010172) 16:50:26.478440 run osmo-nitb_10.42.42.2(pid=26296): stderr: | (launched: 2022-12-10_16:50:26.055247) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:26.604317 run osmo-nitb_10.42.42.2(pid=26296): stdout: | (launched: 2022-12-10_16:50:26.010172) 16:50:26.725090 run osmo-nitb_10.42.42.2(pid=26296): stderr: | (launched: 2022-12-10_16:50:26.055247) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:26.869129 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=26296): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26296) [trial-2376↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26296)] [trial-2376↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 16:50:26.877429 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 16:50:26.884021 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26295): Terminating (SIGTERM) 16:50:27.092863 --- ParallelTerminationStrategy: PID 26295 died... 16:50:27.113070 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26295): Terminated: ok {rc=0} 16:50:27.198857 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 16:50:28.286343 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:50:28.297837 tst nitb_smpp: Using 1 x bts (candidates: 1) 16:50:28.333709 tst esme_ms_sms_transaction.py: using LAC 29321 16:50:28.452680 tst esme_ms_sms_transaction.py: using RAC 251 16:50:28.569880 tst esme_ms_sms_transaction.py: using CellId 29321 16:50:28.688375 tst esme_ms_sms_transaction.py: using BVCI 29322 16:50:28.799430 tst nitb_smpp: Using 1 x modem (candidates: 1) 16:50:28.927624 tst esme_ms_sms_transaction.py: using MSISDN 7804 16:50:29.043454 tst esme_ms_sms_transaction.py:18: start nitb and bts... 16:50:29.260048 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:50:29.909942 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26297): Launched 16:50:30.229462 run osmo-nitb_10.42.42.2(pid=26298): Launched 16:50:30.406714 run osmo-nitb_10.42.42.2(pid=26298): ERR: Terminated: ERROR {rc=2} [trial-2376↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26298)] 16:50:30.550294 run osmo-nitb_10.42.42.2(pid=26298): stdout: | (launched: 2022-12-10_16:50:30.171682) 16:50:30.695462 run osmo-nitb_10.42.42.2(pid=26298): stderr: | (launched: 2022-12-10_16:50:30.219368) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:30.844444 run osmo-nitb_10.42.42.2(pid=26298): stdout: | (launched: 2022-12-10_16:50:30.171682) 16:50:30.988208 run osmo-nitb_10.42.42.2(pid=26298): stderr: | (launched: 2022-12-10_16:50:30.219368) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd2a2ca5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26298): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26298) [trial-2376↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26298)] 16:50:31.349751 tst osmo-nitb_10.42.42.2(pid=26298): stdout: | (launched: 2022-12-10_16:50:30.171682) 16:50:31.483548 tst osmo-nitb_10.42.42.2(pid=26298): stderr: | (launched: 2022-12-10_16:50:30.219368) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:31.640360 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=26298): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26298) [trial-2376↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26298)] [trial-2376↪nitb_smpp↪esme_ms_sms_transaction.py:21] 16:50:31.649967 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 16:50:31.657490 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26297): Terminating (SIGTERM) 16:50:31.871137 --- ParallelTerminationStrategy: PID 26297 died... 16:50:31.891119 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26297): Terminated: ok {rc=0} 16:50:31.979231 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 smpp --------------------------------------------------------------------- 16:50:33.147616 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:50:33.150652 tst smpp: Verifying 1 x bts (candidates: 11) 16:50:33.171811 tst smpp: Verifying 6 x ip_address (candidates: 9) 16:50:33.198615 tst smpp: Verifying 1 x modem (candidates: 12) 16:50:33.233178 tst smpp: Reserving 1 x bts (candidates: 11) 16:50:33.253333 tst smpp: Reserving 6 x ip_address (candidates: 9) 16:50:33.279760 tst smpp: Reserving 1 x modem (candidates: 12) 16:50:33.807213 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 16:50:33.812365 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:33.822894 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:33.834088 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:33.844523 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:33.862690 tst esme_connect_policy_acceptall.py: using MSISDN 7805 16:50:33.981713 run osmo-stp_10.42.42.4: Starting osmo-stp 16:50:34.529978 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26303): Launched 16:50:34.850690 run osmo-stp_10.42.42.4(pid=26304): Launched 16:50:34.972857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:35.469839 run create_hlr_db(pid=26305): Launched 16:50:35.599976 bus /sierra_2: Setting Powered False 16:50:36.662412 run create_hlr_db(pid=26305): Terminated: ok {rc=0} 16:50:37.108323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26307): Launched 16:50:37.427703 run osmo-hlr_10.42.42.2(pid=26308): Launched 16:50:37.548570 run osmo-msc_10.42.42.5: Starting osmo-msc 16:50:38.128249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26310): Launched 16:50:38.448072 run osmo-msc_10.42.42.5(pid=26311): Launched 16:50:38.626373 run osmo-hlr_10.42.42.2(pid=26308): ERR: Terminated: ERROR {rc=237} [trial-2376↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26308)] 16:50:38.764035 run osmo-hlr_10.42.42.2(pid=26308): stdout: | (launched: 2022-12-10_16:50:37.369630) 16:50:38.900775 run osmo-hlr_10.42.42.2(pid=26308): stderr: | [0;m[1;31m20221210165037562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165037563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165037563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165037563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165037563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165037563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165037575 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165037583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165037584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165037584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:39.035763 run osmo-hlr_10.42.42.2(pid=26308): stdout: | (launched: 2022-12-10_16:50:37.369630) 16:50:39.164037 run osmo-hlr_10.42.42.2(pid=26308): stderr: | [0;m[1;31m20221210165037562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165037563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165037563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165037563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165037563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165037563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165037575 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165037583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165037584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165037584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:39.317461 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=26308): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26308) [trial-2376↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26308)] [trial-2376↪smpp↪esme_connect_policy_acceptall.py:23] 16:50:39.326370 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.5 sec) 16:50:39.354087 run osmo-msc_10.42.42.5(pid=26311): ERR: Terminated: ERROR {rc=9} [trial-2376↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=26311)] 16:50:39.404537 run osmo-msc_10.42.42.5(pid=26311): stdout: | (launched: 2022-12-10_16:50:38.389708) 16:50:39.456116 run osmo-msc_10.42.42.5(pid=26311): stderr: | [0;m[38;5;43m20221210165038755 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221210165038755 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221210165038755 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221210165038756 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221210165038756 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221210165038756 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221210165038756 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221210165038756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210165038756 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 16:50:39.507988 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26303): Terminating (SIGTERM) 16:50:39.549688 run osmo-stp_10.42.42.4(pid=26304): Terminating (SIGTERM) 16:50:39.591841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26307): Terminating (SIGTERM) 16:50:39.635210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26310): Terminating (SIGTERM) 16:50:39.680098 --- ParallelTerminationStrategy: PID 26303 died... 16:50:39.700457 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26303): Terminated: ok {rc=0} 16:50:39.749722 --- ParallelTerminationStrategy: PID 26304 died... 16:50:39.769460 run osmo-stp_10.42.42.4(pid=26304): Terminated: ok {rc=0} 16:50:39.816173 --- ParallelTerminationStrategy: PID 26307 died... 16:50:39.835929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26307): Terminated: ok {rc=0} 16:50:39.882299 --- ParallelTerminationStrategy: PID 26310 died... 16:50:39.901974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26310): Terminated: ok {rc=0} ---------------------------------------------- trial-2376 smpp esme_connect_policy_closed.py ---------------------------------------------- 16:50:39.953208 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:39.964565 tst smpp: Using 1 x bts (candidates: 1) 16:50:40.001533 tst esme_connect_policy_closed.py: using LAC 29322 16:50:40.133303 tst esme_connect_policy_closed.py: using RAC 252 16:50:40.252188 tst esme_connect_policy_closed.py: using CellId 29322 16:50:40.370011 tst esme_connect_policy_closed.py: using BVCI 29323 16:50:40.481966 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:40.492364 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:40.502828 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:40.521399 tst esme_connect_policy_closed.py: using MSISDN 7806 16:50:40.638685 tst esme_connect_policy_closed.py: using MSISDN 7807 16:50:40.747246 run osmo-stp_10.42.42.4: Starting osmo-stp 16:50:41.261169 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26314): Launched 16:50:41.563205 run osmo-stp_10.42.42.4(pid=26315): Launched 16:50:41.678703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:42.146186 run create_hlr_db(pid=26316): Launched 16:50:43.315735 run create_hlr_db(pid=26316): Terminated: ok {rc=0} 16:50:43.634344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26318): Launched 16:50:43.935139 run osmo-hlr_10.42.42.2(pid=26319): Launched 16:50:44.049545 run osmo-msc_10.42.42.5: Starting osmo-msc 16:50:44.599343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26321): Launched 16:50:44.901245 run osmo-msc_10.42.42.5(pid=26322): Launched 16:50:45.071604 run osmo-hlr_10.42.42.2(pid=26319): ERR: Terminated: ERROR {rc=237} [trial-2376↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26319)] 16:50:45.206212 run osmo-hlr_10.42.42.2(pid=26319): stdout: | (launched: 2022-12-10_16:50:43.879993) 16:50:45.345437 run osmo-hlr_10.42.42.2(pid=26319): stderr: | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165044064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165044074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165044074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165044074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:45.481804 run osmo-hlr_10.42.42.2(pid=26319): stdout: | (launched: 2022-12-10_16:50:43.879993) 16:50:45.612170 run osmo-hlr_10.42.42.2(pid=26319): stderr: | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165044052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165044064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165044074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165044074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165044074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:45.767974 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=26319): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26319) [trial-2376↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26319)] [trial-2376↪smpp↪esme_connect_policy_closed.py:31] 16:50:45.776919 tst esme_connect_policy_closed.py:31: Test FAILED (5.8 sec) 16:50:45.805067 run osmo-msc_10.42.42.5(pid=26322): ERR: Terminated: ERROR {rc=9} [trial-2376↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=26322)] 16:50:45.860913 run osmo-msc_10.42.42.5(pid=26322): stdout: | (launched: 2022-12-10_16:50:44.845957) 16:50:45.914810 run osmo-msc_10.42.42.5(pid=26322): stderr: | [0;m[38;5;43m20221210165045160 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221210165045160 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221210165045160 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221210165045160 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221210165045160 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221210165045160 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221210165045161 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221210165045161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210165045161 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 16:50:45.969438 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26314): Terminating (SIGTERM) 16:50:46.015275 run osmo-stp_10.42.42.4(pid=26315): Terminating (SIGTERM) 16:50:46.069490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26318): Terminating (SIGTERM) 16:50:46.113993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26321): Terminating (SIGTERM) 16:50:46.159590 --- ParallelTerminationStrategy: PID 26314 died... 16:50:46.179770 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26314): Terminated: ok {rc=0} 16:50:46.231060 --- ParallelTerminationStrategy: PID 26318 died... 16:50:46.251105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26318): Terminated: ok {rc=0} 16:50:46.315305 --- ParallelTerminationStrategy: PID 26315 died... 16:50:46.341606 run osmo-stp_10.42.42.4(pid=26315): Terminated: ok {rc=0} 16:50:46.403071 --- ParallelTerminationStrategy: PID 26321 died... 16:50:46.428491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26321): Terminated: ok {rc=0} ---------------------------------------------- trial-2376 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 16:50:46.486300 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:46.498960 tst smpp: Using 1 x bts (candidates: 1) 16:50:46.540270 tst esme_ms_sms_storeforward.py: using LAC 29323 16:50:46.708399 tst esme_ms_sms_storeforward.py: using RAC 253 16:50:46.832066 tst esme_ms_sms_storeforward.py: using CellId 29323 16:50:46.998465 tst esme_ms_sms_storeforward.py: using BVCI 29324 16:50:47.136182 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:47.147853 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:47.159307 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:47.170823 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:47.182349 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:47.193962 tst smpp: Using 1 x modem (candidates: 1) 16:50:47.318313 tst esme_ms_sms_storeforward.py: using MSISDN 7808 16:50:47.438886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:47.947683 run create_hlr_db(pid=26325): Launched 16:50:49.138939 run create_hlr_db(pid=26325): Terminated: ok {rc=0} 16:50:49.483042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26327): Launched 16:50:49.809730 run osmo-hlr_10.42.42.2(pid=26328): Launched 16:50:49.934255 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:50.499239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26330): Launched 16:50:50.826606 run osmo-stp_10.42.42.5(pid=26331): Launched 16:50:50.951067 run osmo-msc_10.42.42.6: Starting osmo-msc 16:50:51.538219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26333): Launched 16:50:51.864918 run osmo-msc_10.42.42.6(pid=26334): Launched 16:50:52.045787 run osmo-stp_10.42.42.5(pid=26331): ERR: Terminated: ERROR {rc=1} [trial-2376↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26331)] 16:50:52.183073 run osmo-stp_10.42.42.5(pid=26331): stdout: | (launched: 2022-12-10_16:50:50.766583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:52.320374 run osmo-stp_10.42.42.5(pid=26331): stderr: | [0;m[38;5;43m20221210165050961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165050961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165050961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165050962 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165050962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165050962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165050962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:52.457365 run osmo-stp_10.42.42.5(pid=26331): stdout: | (launched: 2022-12-10_16:50:50.766583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:52.587277 run osmo-stp_10.42.42.5(pid=26331): stderr: | [0;m[38;5;43m20221210165050961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165050961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165050961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165050962 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165050962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165050962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165050962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:52.742551 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=26331): Process ended prematurely: osmo-stp_10.42.42.5(pid=26331) [trial-2376↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26331)] [trial-2376↪smpp↪esme_ms_sms_storeforward.py:30] 16:50:52.751567 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.3 sec) 16:50:52.779065 run osmo-hlr_10.42.42.2(pid=26328): ERR: Terminated: ERROR {rc=237} [trial-2376↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26328)] 16:50:52.829625 run osmo-hlr_10.42.42.2(pid=26328): stdout: | (launched: 2022-12-10_16:50:49.749724) 16:50:52.881677 run osmo-hlr_10.42.42.2(pid=26328): stderr: | [0;m[1;31m20221210165049952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165049952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165049952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165049952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165049952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165049952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165049962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165049970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165049971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165049971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:52.953959 run osmo-msc_10.42.42.6(pid=26334): ERR: Terminated: ERROR {rc=2} [trial-2376↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26334)] 16:50:53.004128 run osmo-msc_10.42.42.6(pid=26334): stdout: | (launched: 2022-12-10_16:50:51.804568) 16:50:53.055617 run osmo-msc_10.42.42.6(pid=26334): stderr: | [0;m[38;5;43m20221210165052127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165052127 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b09828c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165052127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165052127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165052127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165052128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165052129 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165052130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165052130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165052130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:50:53.107640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26327): Terminating (SIGTERM) 16:50:53.149341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26330): Terminating (SIGTERM) 16:50:53.191094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26333): Terminating (SIGTERM) 16:50:53.233191 --- ParallelTerminationStrategy: PID 26327 died... 16:50:53.253368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26327): Terminated: ok {rc=0} 16:50:53.300115 --- ParallelTerminationStrategy: PID 26330 died... 16:50:53.319641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26330): Terminated: ok {rc=0} 16:50:53.366308 --- ParallelTerminationStrategy: PID 26333 died... 16:50:53.386141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26333): Terminated: ok {rc=0} 16:50:53.474442 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 smpp esme_ms_sms_transaction.py ---------------------------------------------- 16:50:54.562880 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:54.575155 tst smpp: Using 1 x bts (candidates: 1) 16:50:54.619705 tst esme_ms_sms_transaction.py: using LAC 29324 16:50:54.752776 tst esme_ms_sms_transaction.py: using RAC 254 16:50:54.880546 tst esme_ms_sms_transaction.py: using CellId 29324 16:50:55.006488 tst esme_ms_sms_transaction.py: using BVCI 29325 16:50:55.124092 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:55.135023 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:55.145982 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:55.156768 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:55.167569 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:55.178308 tst smpp: Using 1 x modem (candidates: 1) 16:50:55.306884 tst esme_ms_sms_transaction.py: using MSISDN 7809 16:50:55.424775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:55.930295 run create_hlr_db(pid=26336): Launched 16:50:56.062589 bus /sierra_2: Setting Powered False 16:50:57.128092 run create_hlr_db(pid=26336): Terminated: ok {rc=0} 16:50:57.565715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26338): Launched 16:50:57.873493 run osmo-hlr_10.42.42.2(pid=26339): Launched 16:50:57.990614 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:58.528925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26341): Launched 16:50:58.855629 run osmo-stp_10.42.42.5(pid=26342): Launched 16:50:58.979092 run osmo-msc_10.42.42.6: Starting osmo-msc 16:50:59.568617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26344): Launched 16:50:59.895366 run osmo-msc_10.42.42.6(pid=26345): Launched 16:51:00.076801 run osmo-stp_10.42.42.5(pid=26342): ERR: Terminated: ERROR {rc=1} [trial-2376↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26342)] 16:51:00.214023 run osmo-stp_10.42.42.5(pid=26342): stdout: | (launched: 2022-12-10_16:50:58.795534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:00.351819 run osmo-stp_10.42.42.5(pid=26342): stderr: | [0;m[38;5;43m20221210165058991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165058991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165058991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165058992 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165058992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165058992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165058992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:00.488760 run osmo-stp_10.42.42.5(pid=26342): stdout: | (launched: 2022-12-10_16:50:58.795534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:00.619454 run osmo-stp_10.42.42.5(pid=26342): stderr: | [0;m[38;5;43m20221210165058991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165058991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165058991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165058992 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165058992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165058992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165058992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:00.775484 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=26342): Process ended prematurely: osmo-stp_10.42.42.5(pid=26342) [trial-2376↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26342)] [trial-2376↪smpp↪esme_ms_sms_transaction.py:28] 16:51:00.784575 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 16:51:00.812526 run osmo-hlr_10.42.42.2(pid=26339): ERR: Terminated: ERROR {rc=237} [trial-2376↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26339)] 16:51:00.863712 run osmo-hlr_10.42.42.2(pid=26339): stdout: | (launched: 2022-12-10_16:50:57.816768) 16:51:00.917131 run osmo-hlr_10.42.42.2(pid=26339): stderr: | [0;m[1;31m20221210165057994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165057994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165057994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165057994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165057994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165057994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165058006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165058015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165058015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165058015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:00.991153 run osmo-msc_10.42.42.6(pid=26345): ERR: Terminated: ERROR {rc=2} [trial-2376↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26345)] 16:51:01.042438 run osmo-msc_10.42.42.6(pid=26345): stdout: | (launched: 2022-12-10_16:50:59.835526) 16:51:01.095660 run osmo-msc_10.42.42.6(pid=26345): stderr: | [0;m[38;5;43m20221210165100160 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165100160 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5661bbfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165100160 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165100160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165100161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165100161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165100163 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165100163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165100163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165100164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:01.149535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26338): Terminating (SIGTERM) 16:51:01.193039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26341): Terminating (SIGTERM) 16:51:01.238205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26344): Terminating (SIGTERM) 16:51:01.282694 --- ParallelTerminationStrategy: PID 26338 died... 16:51:01.303220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26338): Terminated: ok {rc=0} 16:51:01.351033 --- ParallelTerminationStrategy: PID 26341 died... 16:51:01.371329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26341): Terminated: ok {rc=0} 16:51:01.419006 --- ParallelTerminationStrategy: PID 26344 died... 16:51:01.439218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26344): Terminated: ok {rc=0} 16:51:01.529368 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 encryption --------------------------------------------------------------------- 16:51:02.724660 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:51:02.727640 tst encryption: Verifying 1 x bts (candidates: 11) 16:51:02.749290 tst encryption: Verifying 6 x ip_address (candidates: 9) 16:51:02.777087 tst encryption: Verifying 1 x modem (candidates: 12) 16:51:02.815653 tst encryption: Reserving 1 x bts (candidates: 11) 16:51:02.837862 tst encryption: Reserving 6 x ip_address (candidates: 9) 16:51:02.866118 tst encryption: Reserving 1 x modem (candidates: 12) 16:51:03.389608 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2376 encryption register_a5_0_authopt.py ---------------------------------------------- 16:51:03.446256 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:03.457452 tst encryption: Using 1 x bts (candidates: 1) 16:51:03.493938 tst register_a5_0_authopt.py: using LAC 29325 16:51:03.624550 tst register_a5_0_authopt.py: using RAC 255 16:51:03.755543 tst register_a5_0_authopt.py: using CellId 29325 16:51:03.889858 tst register_a5_0_authopt.py: using BVCI 29326 16:51:04.010490 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:04.021440 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:04.032279 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:04.043287 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:04.054240 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:04.064928 tst encryption: Using 1 x modem (candidates: 1) 16:51:04.179726 tst register_a5_0_authopt.py:8: start network... 16:51:04.389480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:04.868638 run create_hlr_db(pid=26350): Launched 16:51:04.988026 bus /sierra_2: Setting Powered False 16:51:06.049977 run create_hlr_db(pid=26350): Terminated: ok {rc=0} 16:51:06.500696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26352): Launched 16:51:06.830223 run osmo-hlr_10.42.42.2(pid=26353): Launched 16:51:06.955594 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:07.523835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26355): Launched 16:51:07.852847 run osmo-stp_10.42.42.5(pid=26356): Launched 16:51:07.978621 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:08.573332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26358): Launched 16:51:08.902037 run osmo-msc_10.42.42.6(pid=26359): Launched 16:51:09.084239 run osmo-stp_10.42.42.5(pid=26356): ERR: Terminated: ERROR {rc=1} [trial-2376↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26356)] 16:51:09.221891 run osmo-stp_10.42.42.5(pid=26356): stdout: | (launched: 2022-12-10_16:51:07.792297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:09.360429 run osmo-stp_10.42.42.5(pid=26356): stderr: | [0;m[38;5;43m20221210165107987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165107987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165107987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165107988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165107990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165107990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165107990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:09.498289 run osmo-stp_10.42.42.5(pid=26356): stdout: | (launched: 2022-12-10_16:51:07.792297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:09.628702 run osmo-stp_10.42.42.5(pid=26356): stderr: | [0;m[38;5;43m20221210165107987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165107987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165107987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165107988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165107990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165107990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165107990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:09.785369 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26356): Process ended prematurely: osmo-stp_10.42.42.5(pid=26356) [trial-2376↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26356)] [trial-2376↪encryption↪register_a5_0_authopt.py:8] 16:51:09.795287 tst register_a5_0_authopt.py:8: Test FAILED (6.4 sec) 16:51:09.823299 run osmo-hlr_10.42.42.2(pid=26353): ERR: Terminated: ERROR {rc=237} [trial-2376↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26353)] 16:51:09.873752 run osmo-hlr_10.42.42.2(pid=26353): stdout: | (launched: 2022-12-10_16:51:06.769892) 16:51:09.925834 run osmo-hlr_10.42.42.2(pid=26353): stderr: | [0;m[1;31m20221210165106969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165106969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165106969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165106970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165106970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165106970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165106982 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165106991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165106991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165106991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:09.998371 run osmo-msc_10.42.42.6(pid=26359): ERR: Terminated: ERROR {rc=2} [trial-2376↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26359)] 16:51:10.048467 run osmo-msc_10.42.42.6(pid=26359): stdout: | (launched: 2022-12-10_16:51:08.842004) 16:51:10.100287 run osmo-msc_10.42.42.6(pid=26359): stderr: | [0;m[38;5;43m20221210165109163 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165109163 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb08140fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165109163 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165109164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165109164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165109164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165109166 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165109166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165109166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165109166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:10.152550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26352): Terminating (SIGTERM) 16:51:10.194483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26355): Terminating (SIGTERM) 16:51:10.236520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26358): Terminating (SIGTERM) 16:51:10.278819 --- ParallelTerminationStrategy: PID 26352 died... 16:51:10.299306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26352): Terminated: ok {rc=0} 16:51:10.346479 --- ParallelTerminationStrategy: PID 26355 died... 16:51:10.366266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26355): Terminated: ok {rc=0} 16:51:10.412877 --- ParallelTerminationStrategy: PID 26358 died... 16:51:10.433037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26358): Terminated: ok {rc=0} 16:51:10.520331 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 encryption register_a5_0_authreq.py ---------------------------------------------- 16:51:11.670101 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:11.681627 tst encryption: Using 1 x bts (candidates: 1) 16:51:11.718782 tst register_a5_0_authreq.py: using LAC 29326 16:51:11.841211 tst register_a5_0_authreq.py: using RAC 1 16:51:11.963492 tst register_a5_0_authreq.py: using CellId 29326 16:51:12.086976 tst register_a5_0_authreq.py: using BVCI 29327 16:51:12.200201 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:12.210951 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:12.221665 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:12.232754 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:12.243857 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:12.255019 tst encryption: Using 1 x modem (candidates: 1) 16:51:12.377461 tst register_a5_0_authreq.py:8: start network... 16:51:12.601841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:13.112373 run create_hlr_db(pid=26361): Launched 16:51:13.245467 bus /sierra_2: Setting Powered False 16:51:14.310956 run create_hlr_db(pid=26361): Terminated: ok {rc=0} 16:51:14.770584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26363): Launched 16:51:15.100316 run osmo-hlr_10.42.42.2(pid=26364): Launched 16:51:15.226477 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:15.794977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26366): Launched 16:51:16.144174 run osmo-stp_10.42.42.5(pid=26367): Launched 16:51:16.390877 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:17.105861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26369): Launched 16:51:17.426521 run osmo-msc_10.42.42.6(pid=26370): Launched 16:51:17.602846 run osmo-stp_10.42.42.5(pid=26367): ERR: Terminated: ERROR {rc=1} [trial-2376↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26367)] 16:51:17.734959 run osmo-stp_10.42.42.5(pid=26367): stdout: | (launched: 2022-12-10_16:51:16.083872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:17.866144 run osmo-stp_10.42.42.5(pid=26367): stderr: | [0;m[38;5;43m20221210165116410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165116410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165116410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165116410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165116411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165116411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165116411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:17.994663 run osmo-stp_10.42.42.5(pid=26367): stdout: | (launched: 2022-12-10_16:51:16.083872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:18.117997 run osmo-stp_10.42.42.5(pid=26367): stderr: | [0;m[38;5;43m20221210165116410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165116410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165116410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165116410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165116411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165116411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165116411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:18.265244 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26367): Process ended prematurely: osmo-stp_10.42.42.5(pid=26367) [trial-2376↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26367)] [trial-2376↪encryption↪register_a5_0_authreq.py:8] 16:51:18.274001 tst register_a5_0_authreq.py:8: Test FAILED (6.6 sec) 16:51:18.301243 run osmo-hlr_10.42.42.2(pid=26364): ERR: Terminated: ERROR {rc=237} [trial-2376↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26364)] 16:51:18.350201 run osmo-hlr_10.42.42.2(pid=26364): stdout: | (launched: 2022-12-10_16:51:15.040159) 16:51:18.400618 run osmo-hlr_10.42.42.2(pid=26364): stderr: | [0;m[1;31m20221210165115240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165115240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165115240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165115240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165115240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165115241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165115253 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165115261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165115261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165115261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:18.470987 run osmo-msc_10.42.42.6(pid=26370): ERR: Terminated: ERROR {rc=2} [trial-2376↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26370)] 16:51:18.519465 run osmo-msc_10.42.42.6(pid=26370): stdout: | (launched: 2022-12-10_16:51:17.369393) 16:51:18.569739 run osmo-msc_10.42.42.6(pid=26370): stderr: | [0;m[38;5;43m20221210165117642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165117642 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f864331ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165117643 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165117643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165117643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165117643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165117645 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165117645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165117645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165117645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:18.620437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26363): Terminating (SIGTERM) 16:51:18.662409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26366): Terminating (SIGTERM) 16:51:18.702956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26369): Terminating (SIGTERM) 16:51:18.743412 --- ParallelTerminationStrategy: PID 26363 died... 16:51:18.762686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26363): Terminated: ok {rc=0} 16:51:18.807841 --- ParallelTerminationStrategy: PID 26366 died... 16:51:18.826765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26366): Terminated: ok {rc=0} 16:51:18.872028 --- ParallelTerminationStrategy: PID 26369 died... 16:51:18.890854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26369): Terminated: ok {rc=0} 16:51:18.975974 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 encryption register_a5_1_authreq.py ---------------------------------------------- 16:51:20.130032 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:20.142055 tst encryption: Using 1 x bts (candidates: 1) 16:51:20.181565 tst register_a5_1_authreq.py: using LAC 29327 16:51:20.312402 tst register_a5_1_authreq.py: using RAC 2 16:51:20.443836 tst register_a5_1_authreq.py: using CellId 29327 16:51:20.566419 tst register_a5_1_authreq.py: using BVCI 29328 16:51:20.678657 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:20.689513 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:20.700191 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:20.711297 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:20.722116 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:20.733072 tst encryption: Using 1 x modem (candidates: 1) 16:51:20.851739 tst register_a5_1_authreq.py:8: start network... 16:51:21.076132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:21.585266 run create_hlr_db(pid=26372): Launched 16:51:21.718772 bus /sierra_2: Setting Powered False 16:51:22.783562 run create_hlr_db(pid=26372): Terminated: ok {rc=0} 16:51:23.227529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26374): Launched 16:51:23.537350 run osmo-hlr_10.42.42.2(pid=26375): Launched 16:51:23.656526 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:24.202577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26377): Launched 16:51:24.512920 run osmo-stp_10.42.42.5(pid=26378): Launched 16:51:24.632514 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:25.189658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26380): Launched 16:51:25.498356 run osmo-msc_10.42.42.6(pid=26381): Launched 16:51:25.673621 run osmo-stp_10.42.42.5(pid=26378): ERR: Terminated: ERROR {rc=1} [trial-2376↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26378)] 16:51:25.804087 run osmo-stp_10.42.42.5(pid=26378): stdout: | (launched: 2022-12-10_16:51:24.455746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:25.940291 run osmo-stp_10.42.42.5(pid=26378): stderr: | [0;m[38;5;43m20221210165124628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165124628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165124628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165124629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165124629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165124629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165124629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:26.077881 run osmo-stp_10.42.42.5(pid=26378): stdout: | (launched: 2022-12-10_16:51:24.455746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:26.209407 run osmo-stp_10.42.42.5(pid=26378): stderr: | [0;m[38;5;43m20221210165124628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165124628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165124628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165124629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165124629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165124629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165124629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:26.366623 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26378): Process ended prematurely: osmo-stp_10.42.42.5(pid=26378) [trial-2376↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26378)] [trial-2376↪encryption↪register_a5_1_authreq.py:8] 16:51:26.376173 tst register_a5_1_authreq.py:8: Test FAILED (6.3 sec) 16:51:26.404567 run osmo-hlr_10.42.42.2(pid=26375): ERR: Terminated: ERROR {rc=237} [trial-2376↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26375)] 16:51:26.455924 run osmo-hlr_10.42.42.2(pid=26375): stdout: | (launched: 2022-12-10_16:51:23.480148) 16:51:26.508324 run osmo-hlr_10.42.42.2(pid=26375): stderr: | [0;m[1;31m20221210165123659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165123659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165123659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165123659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165123659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165123659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165123670 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165123679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165123679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165123679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:26.581365 run osmo-msc_10.42.42.6(pid=26381): ERR: Terminated: ERROR {rc=2} [trial-2376↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26381)] 16:51:26.631523 run osmo-msc_10.42.42.6(pid=26381): stdout: | (launched: 2022-12-10_16:51:25.441141) 16:51:26.683513 run osmo-msc_10.42.42.6(pid=26381): stderr: | [0;m[38;5;43m20221210165125714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165125714 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0470b54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165125714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165125714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165125714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165125715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165125716 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165125717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165125717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165125717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:26.736165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26374): Terminating (SIGTERM) 16:51:26.778447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26377): Terminating (SIGTERM) 16:51:26.821240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26380): Terminating (SIGTERM) 16:51:26.864096 --- ParallelTerminationStrategy: PID 26374 died... 16:51:26.884475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26374): Terminated: ok {rc=0} 16:51:26.931701 --- ParallelTerminationStrategy: PID 26377 died... 16:51:26.951703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26377): Terminated: ok {rc=0} 16:51:26.999013 --- ParallelTerminationStrategy: PID 26380 died... 16:51:27.019069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26380): Terminated: ok {rc=0} 16:51:27.107728 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2376 encryption register_a5_3_authreq.py ---------------------------------------------- 16:51:28.259766 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:28.271220 tst encryption: Using 1 x bts (candidates: 1) 16:51:28.308123 tst register_a5_3_authreq.py: using LAC 29328 16:51:28.430641 tst register_a5_3_authreq.py: using RAC 3 16:51:28.552900 tst register_a5_3_authreq.py: using CellId 29328 16:51:28.675351 tst register_a5_3_authreq.py: using BVCI 29329 16:51:28.789140 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:28.799681 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:28.810188 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:28.820890 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:28.832100 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:28.842894 tst encryption: Using 1 x modem (candidates: 1) 16:51:28.971635 tst register_a5_3_authreq.py:8: start network... 16:51:29.197419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:29.708533 run create_hlr_db(pid=26383): Launched 16:51:29.842044 bus /sierra_2: Setting Powered False 16:51:30.918664 run create_hlr_db(pid=26383): Terminated: ok {rc=0} 16:51:31.369740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26385): Launched 16:51:31.700425 run osmo-hlr_10.42.42.2(pid=26386): Launched 16:51:31.895238 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:32.638832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26388): Launched 16:51:32.968539 run osmo-stp_10.42.42.5(pid=26389): Launched 16:51:33.094508 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:33.691916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26391): Launched 16:51:34.021310 run osmo-msc_10.42.42.6(pid=26392): Launched 16:51:34.204266 run osmo-stp_10.42.42.5(pid=26389): ERR: Terminated: ERROR {rc=1} [trial-2376↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26389)] 16:51:34.343305 run osmo-stp_10.42.42.5(pid=26389): stdout: | (launched: 2022-12-10_16:51:32.908450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:34.483294 run osmo-stp_10.42.42.5(pid=26389): stderr: | [0;m[38;5;43m20221210165133101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165133101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165133101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165133102 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165133102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165133102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165133102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:34.621712 run osmo-stp_10.42.42.5(pid=26389): stdout: | (launched: 2022-12-10_16:51:32.908450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:34.752881 run osmo-stp_10.42.42.5(pid=26389): stderr: | [0;m[38;5;43m20221210165133101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165133101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165133101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165133102 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165133102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165133102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165133102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:34.910575 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26389): Process ended prematurely: osmo-stp_10.42.42.5(pid=26389) [trial-2376↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26389)] [trial-2376↪encryption↪register_a5_3_authreq.py:8] 16:51:34.920211 tst register_a5_3_authreq.py:8: Test FAILED (6.7 sec) 16:51:34.948074 run osmo-hlr_10.42.42.2(pid=26386): ERR: Terminated: ERROR {rc=237} [trial-2376↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26386)] 16:51:34.998090 run osmo-hlr_10.42.42.2(pid=26386): stdout: | (launched: 2022-12-10_16:51:31.638688) 16:51:35.049816 run osmo-hlr_10.42.42.2(pid=26386): stderr: | [0;m[1;31m20221210165131954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165131954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165131954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165131954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165131954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165131955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165131976 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165131992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165131992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165131992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:35.122451 run osmo-msc_10.42.42.6(pid=26392): ERR: Terminated: ERROR {rc=2} [trial-2376↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26392)] 16:51:35.172109 run osmo-msc_10.42.42.6(pid=26392): stdout: | (launched: 2022-12-10_16:51:33.961272) 16:51:35.223574 run osmo-msc_10.42.42.6(pid=26392): stderr: | [0;m[38;5;43m20221210165134286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165134286 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f27a85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165134286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165134286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165134287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165134287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165134288 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165134289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165134289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165134289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:35.275370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26385): Terminating (SIGTERM) 16:51:35.317068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26388): Terminating (SIGTERM) 16:51:35.358906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26391): Terminating (SIGTERM) 16:51:35.400744 --- ParallelTerminationStrategy: PID 26385 died... 16:51:35.420724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26385): Terminated: ok {rc=0} 16:51:35.467014 --- ParallelTerminationStrategy: PID 26388 died... 16:51:35.486558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26388): Terminated: ok {rc=0} 16:51:35.532600 --- ParallelTerminationStrategy: PID 26391 died... 16:51:35.552167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26391): Terminated: ok {rc=0} 16:51:35.639293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 16:51:36.854789 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:51:36.860401 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 16:51:36.879724 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 16:51:36.907331 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 16:51:36.934373 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 16:51:36.952867 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 16:51:36.979820 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 16:51:37.493627 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2376 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 16:51:37.498413 tst handover.py:11: TEST_CONFIG: {} 16:51:37.720919 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:51:37.737381 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:51:37.761380 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:51:37.810878 tst handover.py: using MSISDN 7810 16:51:37.931570 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7810', subscriber_id=0} 16:51:38.047257 run srsepc_10.42.42.118: Starting srsepc 16:51:39.958660 run rm-remote-dir(pid=26397): Launched 16:51:40.090349 bus /sierra_2: Setting Powered False 16:51:41.159387 run rm-remote-dir(pid=26397): Terminated: ok {rc=0} 16:51:41.632385 run mk-remote-dir(pid=26398): Launched 16:51:42.819521 run mk-remote-dir(pid=26398): Terminated: ok {rc=0} 16:51:43.109963 run scp-inst-to-remote(pid=26399): Launched 16:51:45.288392 run scp-inst-to-remote(pid=26399): Terminated: ok {rc=0} 16:51:45.626612 run rm-remote-dir(pid=26401): Launched 16:51:46.809362 run rm-remote-dir(pid=26401): Terminated: ok {rc=0} 16:51:47.165751 run mk-remote-dir(pid=26402): Launched 16:51:48.379589 run mk-remote-dir(pid=26402): Terminated: ok {rc=0} 16:51:48.671237 run scp-cfg-to-remote(pid=26403): Launched 16:51:49.847823 run scp-cfg-to-remote(pid=26403): Terminated: ok {rc=0} 16:51:50.135771 run scp-db-to-remote(pid=26405): Launched 16:51:51.317548 run scp-db-to-remote(pid=26405): Terminated: ok {rc=0} 16:51:51.458677 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:51:51.790311 run patchelf(pid=26407): Launched 16:51:52.981030 run patchelf(pid=26407): Terminated: ok {rc=0} 16:51:53.122090 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:51:53.453739 run setcap-netadm(pid=26408): Launched 16:51:54.643583 run setcap-netadm(pid=26408): Terminated: ok {rc=0} 16:51:54.990672 run srsepc(pid=26409): Launched 16:51:55.114244 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:51:56.302827 run rm-remote-dir(pid=26410): Launched 16:51:56.492863 run srsepc(pid=26409): ERR: Terminated: ERROR {rc=127} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26409)] 16:51:56.638340 run srsepc(pid=26409): stdout: | (launched: 2022-12-10_16:51:54.930545) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:51:56.783774 run srsepc(pid=26409): stderr: | (launched: 2022-12-10_16:51:54.979519) | Connection to 10.42.42.116 closed. 16:51:56.929447 run srsepc(pid=26409): stdout: | (launched: 2022-12-10_16:51:54.930545) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:51:57.068161 run srsepc(pid=26409): stderr: | (launched: 2022-12-10_16:51:54.979519) | Connection to 10.42.42.116 closed. 16:51:57.232673 run rm-remote-dir(pid=26410): Terminating (SIGINT) 16:51:57.423459 run rm-remote-dir(pid=26410): Terminated: ok {rc=0} 16:51:57.561503 tst handover.py:37: ERR: Error: srsepc(pid=26409): Process ended prematurely: srsepc(pid=26409) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26409)] [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 16:51:57.571992 tst handover.py:37: Test FAILED (20.1 sec) 16:51:57.653182 run scp-back-log(pid=26411): Launched 16:51:58.734123 run scp-back-log(pid=26411): ERR: Terminated: ERROR {rc=1} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26411)] 16:51:58.798292 run scp-back-log(pid=26411): stdout: | (launched: 2022-12-10_16:51:57.621036) 16:51:58.864700 run scp-back-log(pid=26411): stderr: | (launched: 2022-12-10_16:51:57.641885) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:51:58.938740 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26411): launch_sync(): local process exited with status 1 [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26411)]') ---------------------------------------------- trial-2376 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 16:51:58.986021 tst iperf3_bidir.py:13: Number of physical ue: 1 16:51:59.207771 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:51:59.251586 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 16:51:59.471199 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:51:59.487522 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:51:59.521294 tst iperf3_bidir.py: using MSISDN 7811 16:51:59.641000 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7811', subscriber_id=0} 16:51:59.756551 run srsepc_10.42.42.118: Starting srsepc 16:52:00.430336 run rm-remote-dir(pid=26413): Launched 16:52:01.620243 run rm-remote-dir(pid=26413): Terminated: ok {rc=0} 16:52:01.977199 run mk-remote-dir(pid=26414): Launched 16:52:03.214767 run mk-remote-dir(pid=26414): Terminated: ok {rc=0} 16:52:03.504084 run scp-inst-to-remote(pid=26415): Launched 16:52:05.683537 run scp-inst-to-remote(pid=26415): Terminated: ok {rc=0} 16:52:06.022240 run rm-remote-dir(pid=26417): Launched 16:52:07.202743 run rm-remote-dir(pid=26417): Terminated: ok {rc=0} 16:52:07.542508 run mk-remote-dir(pid=26418): Launched 16:52:08.723208 run mk-remote-dir(pid=26418): Terminated: ok {rc=0} 16:52:09.013741 run scp-cfg-to-remote(pid=26419): Launched 16:52:10.190942 run scp-cfg-to-remote(pid=26419): Terminated: ok {rc=0} 16:52:10.477943 run scp-db-to-remote(pid=26421): Launched 16:52:11.655939 run scp-db-to-remote(pid=26421): Terminated: ok {rc=0} 16:52:11.789053 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:52:12.100100 run patchelf(pid=26423): Launched 16:52:13.276601 run patchelf(pid=26423): Terminated: ok {rc=0} 16:52:13.409527 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:52:13.720249 run setcap-netadm(pid=26424): Launched 16:52:14.897859 run setcap-netadm(pid=26424): Terminated: ok {rc=0} 16:52:15.223840 run srsepc(pid=26425): Launched 16:52:15.339302 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:52:16.496004 run rm-remote-dir(pid=26426): Launched 16:52:16.737903 run srsepc(pid=26425): ERR: Terminated: ERROR {rc=127} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26425)] 16:52:16.914123 run srsepc(pid=26425): stdout: | (launched: 2022-12-10_16:52:15.167003) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:17.055080 run srsepc(pid=26425): stderr: | (launched: 2022-12-10_16:52:15.213154) | Connection to 10.42.42.116 closed. 16:52:17.195254 run srsepc(pid=26425): stdout: | (launched: 2022-12-10_16:52:15.167003) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:17.326785 run srsepc(pid=26425): stderr: | (launched: 2022-12-10_16:52:15.213154) | Connection to 10.42.42.116 closed. 16:52:17.481386 run rm-remote-dir(pid=26426): Terminating (SIGINT) 16:52:17.661470 run rm-remote-dir(pid=26426): Terminated: ok {rc=0} 16:52:17.791931 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=26425): Process ended prematurely: srsepc(pid=26425) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26425)] [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 16:52:17.802458 tst iperf3_bidir.py:42: Test FAILED (18.8 sec) 16:52:17.881159 run scp-back-log(pid=26427): Launched 16:52:18.958736 run scp-back-log(pid=26427): ERR: Terminated: ERROR {rc=1} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26427)] 16:52:19.020178 run scp-back-log(pid=26427): stdout: | (launched: 2022-12-10_16:52:17.850328) 16:52:19.082743 run scp-back-log(pid=26427): stderr: | (launched: 2022-12-10_16:52:17.870375) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:52:19.153252 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26427): launch_sync(): local process exited with status 1 [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26427)]') ---------------------------------------------- trial-2376 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 16:52:19.198947 tst iperf3_dl.py:13: Number of physical ue: 1 16:52:19.406988 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:52:19.451898 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 16:52:19.657188 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:52:19.672922 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:52:19.706034 tst iperf3_dl.py: using MSISDN 7812 16:52:19.819375 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7812', subscriber_id=0} 16:52:19.927977 run srsepc_10.42.42.118: Starting srsepc 16:52:20.561093 run rm-remote-dir(pid=26429): Launched 16:52:21.741134 run rm-remote-dir(pid=26429): Terminated: ok {rc=0} 16:52:22.080389 run mk-remote-dir(pid=26430): Launched 16:52:23.260074 run mk-remote-dir(pid=26430): Terminated: ok {rc=0} 16:52:23.548661 run scp-inst-to-remote(pid=26431): Launched 16:52:25.729303 run scp-inst-to-remote(pid=26431): Terminated: ok {rc=0} 16:52:26.066045 run rm-remote-dir(pid=26433): Launched 16:52:27.246134 run rm-remote-dir(pid=26433): Terminated: ok {rc=0} 16:52:27.584634 run mk-remote-dir(pid=26434): Launched 16:52:28.764283 run mk-remote-dir(pid=26434): Terminated: ok {rc=0} 16:52:29.054062 run scp-cfg-to-remote(pid=26435): Launched 16:52:30.231765 run scp-cfg-to-remote(pid=26435): Terminated: ok {rc=0} 16:52:30.518542 run scp-db-to-remote(pid=26437): Launched 16:52:31.697716 run scp-db-to-remote(pid=26437): Terminated: ok {rc=0} 16:52:31.833711 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:52:32.152063 run patchelf(pid=26439): Launched 16:52:33.350774 run patchelf(pid=26439): Terminated: ok {rc=0} 16:52:33.483662 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:52:33.794207 run setcap-netadm(pid=26440): Launched 16:52:34.971785 run setcap-netadm(pid=26440): Terminated: ok {rc=0} 16:52:35.297949 run srsepc(pid=26441): Launched 16:52:35.412313 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:52:36.567643 run rm-remote-dir(pid=26445): Launched 16:52:36.758531 run srsepc(pid=26441): ERR: Terminated: ERROR {rc=127} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26441)] 16:52:36.904434 run srsepc(pid=26441): stdout: | (launched: 2022-12-10_16:52:35.241194) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:37.050010 run srsepc(pid=26441): stderr: | (launched: 2022-12-10_16:52:35.287006) | Connection to 10.42.42.116 closed. 16:52:37.195137 run srsepc(pid=26441): stdout: | (launched: 2022-12-10_16:52:35.241194) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:37.333841 run srsepc(pid=26441): stderr: | (launched: 2022-12-10_16:52:35.287006) | Connection to 10.42.42.116 closed. 16:52:37.498254 run rm-remote-dir(pid=26445): Terminating (SIGINT) 16:52:37.688211 run rm-remote-dir(pid=26445): Terminated: ok {rc=0} 16:52:37.825094 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=26441): Process ended prematurely: srsepc(pid=26441) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26441)] [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 16:52:37.835992 tst iperf3_dl.py:42: Test FAILED (18.6 sec) 16:52:37.917362 run scp-back-log(pid=26446): Launched 16:52:38.999019 run scp-back-log(pid=26446): ERR: Terminated: ERROR {rc=1} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26446)] 16:52:39.063229 run scp-back-log(pid=26446): stdout: | (launched: 2022-12-10_16:52:37.885225) 16:52:39.128844 run scp-back-log(pid=26446): stderr: | (launched: 2022-12-10_16:52:37.906058) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:52:39.202852 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26446): launch_sync(): local process exited with status 1 [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26446)]') ---------------------------------------------- trial-2376 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 16:52:39.250115 tst iperf3_ul.py:13: Number of physical ue: 1 16:52:39.471024 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:52:39.515070 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 16:52:39.736656 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:52:39.753119 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:52:39.786509 tst iperf3_ul.py: using MSISDN 7813 16:52:39.905750 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7813', subscriber_id=0} 16:52:40.021379 run srsepc_10.42.42.118: Starting srsepc 16:52:40.694437 run rm-remote-dir(pid=26448): Launched 16:52:41.886760 run rm-remote-dir(pid=26448): Terminated: ok {rc=0} 16:52:42.246757 run mk-remote-dir(pid=26449): Launched 16:52:43.438942 run mk-remote-dir(pid=26449): Terminated: ok {rc=0} 16:52:43.745866 run scp-inst-to-remote(pid=26450): Launched 16:52:45.944216 run scp-inst-to-remote(pid=26450): Terminated: ok {rc=0} 16:52:46.388881 run rm-remote-dir(pid=26452): Launched 16:52:47.695260 run rm-remote-dir(pid=26452): Terminated: ok {rc=0} 16:52:48.034509 run mk-remote-dir(pid=26453): Launched 16:52:49.215249 run mk-remote-dir(pid=26453): Terminated: ok {rc=0} 16:52:49.504306 run scp-cfg-to-remote(pid=26454): Launched 16:52:50.682685 run scp-cfg-to-remote(pid=26454): Terminated: ok {rc=0} 16:52:50.970860 run scp-db-to-remote(pid=26456): Launched 16:52:52.148253 run scp-db-to-remote(pid=26456): Terminated: ok {rc=0} 16:52:52.280680 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:52:52.590902 run patchelf(pid=26458): Launched 16:52:53.768666 run patchelf(pid=26458): Terminated: ok {rc=0} 16:52:53.901311 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:52:54.215399 run setcap-netadm(pid=26459): Launched 16:52:55.390494 run setcap-netadm(pid=26459): Terminated: ok {rc=0} 16:52:55.711749 run srsepc(pid=26460): Launched 16:52:55.824434 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:52:56.925278 run rm-remote-dir(pid=26461): Launched 16:52:57.099607 run srsepc(pid=26460): ERR: Terminated: ERROR {rc=127} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26460)] 16:52:57.233916 run srsepc(pid=26460): stdout: | (launched: 2022-12-10_16:52:55.655861) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:57.367961 run srsepc(pid=26460): stderr: | (launched: 2022-12-10_16:52:55.701057) | Connection to 10.42.42.116 closed. 16:52:57.502384 run srsepc(pid=26460): stdout: | (launched: 2022-12-10_16:52:55.655861) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:57.630203 run srsepc(pid=26460): stderr: | (launched: 2022-12-10_16:52:55.701057) | Connection to 10.42.42.116 closed. 16:52:57.781832 run rm-remote-dir(pid=26461): Terminating (SIGINT) 16:52:57.958031 run rm-remote-dir(pid=26461): Terminated: ok {rc=0} 16:52:58.085592 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=26460): Process ended prematurely: srsepc(pid=26460) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26460)] [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 16:52:58.095528 tst iperf3_ul.py:42: Test FAILED (18.8 sec) 16:52:58.172594 run scp-back-log(pid=26462): Launched 16:52:59.248932 run scp-back-log(pid=26462): ERR: Terminated: ERROR {rc=1} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26462)] 16:52:59.309679 run scp-back-log(pid=26462): stdout: | (launched: 2022-12-10_16:52:58.141791) 16:52:59.372042 run scp-back-log(pid=26462): stderr: | (launched: 2022-12-10_16:52:58.161690) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:52:59.442410 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26462): launch_sync(): local process exited with status 1 [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26462)]') ---------------------------------------------- trial-2376 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 16:52:59.488256 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:52:59.504636 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:52:59.527740 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:52:59.582697 tst ping.py: using MSISDN 7814 16:52:59.696354 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7814', subscriber_id=0} 16:52:59.802739 run srsepc_10.42.42.118: Starting srsepc 16:53:00.426197 run rm-remote-dir(pid=26464): Launched 16:53:01.620236 run rm-remote-dir(pid=26464): Terminated: ok {rc=0} 16:53:02.010368 run mk-remote-dir(pid=26465): Launched 16:53:03.295543 run mk-remote-dir(pid=26465): Terminated: ok {rc=0} 16:53:03.598038 run scp-inst-to-remote(pid=26466): Launched 16:53:05.783079 run scp-inst-to-remote(pid=26466): Terminated: ok {rc=0} 16:53:06.114085 run rm-remote-dir(pid=26468): Launched 16:53:07.290415 run rm-remote-dir(pid=26468): Terminated: ok {rc=0} 16:53:07.623762 run mk-remote-dir(pid=26469): Launched 16:53:08.799917 run mk-remote-dir(pid=26469): Terminated: ok {rc=0} 16:53:09.084197 run scp-cfg-to-remote(pid=26470): Launched 16:53:10.257918 run scp-cfg-to-remote(pid=26470): Terminated: ok {rc=0} 16:53:10.539788 run scp-db-to-remote(pid=26472): Launched 16:53:11.714132 run scp-db-to-remote(pid=26472): Terminated: ok {rc=0} 16:53:11.844177 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:53:12.149011 run patchelf(pid=26474): Launched 16:53:13.325430 run patchelf(pid=26474): Terminated: ok {rc=0} 16:53:13.464319 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:53:13.789587 run setcap-netadm(pid=26475): Launched 16:53:14.976467 run setcap-netadm(pid=26475): Terminated: ok {rc=0} 16:53:15.317356 run srsepc(pid=26476): Launched 16:53:15.438568 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:53:16.656625 run rm-remote-dir(pid=26477): Launched 16:53:16.990583 run srsepc(pid=26476): ERR: Terminated: ERROR {rc=127} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26476)] 16:53:17.165616 run srsepc(pid=26476): stdout: | (launched: 2022-12-10_16:53:15.257798) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:53:17.329023 run srsepc(pid=26476): stderr: | (launched: 2022-12-10_16:53:15.306319) | Connection to 10.42.42.116 closed. 16:53:17.475392 run srsepc(pid=26476): stdout: | (launched: 2022-12-10_16:53:15.257798) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:53:17.617999 run srsepc(pid=26476): stderr: | (launched: 2022-12-10_16:53:15.306319) | Connection to 10.42.42.116 closed. 16:53:17.786064 run rm-remote-dir(pid=26477): Terminating (SIGINT) 16:53:17.968265 run rm-remote-dir(pid=26477): Terminated: ok {rc=0} 16:53:18.116585 tst ping.py:16: ERR: Error: srsepc(pid=26476): Process ended prematurely: srsepc(pid=26476) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26476)] [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 16:53:18.127660 tst ping.py:16: Test FAILED (18.6 sec) 16:53:18.232909 run scp-back-log(pid=26550): Launched 16:53:19.349301 run scp-back-log(pid=26550): ERR: Terminated: ERROR {rc=1} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26550)] 16:53:19.412796 run scp-back-log(pid=26550): stdout: | (launched: 2022-12-10_16:53:18.186733) 16:53:19.478836 run scp-back-log(pid=26550): stderr: | (launched: 2022-12-10_16:53:18.206898) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:53:19.551663 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26550): launch_sync(): local process exited with status 1 [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26550)]') ---------------------------------------------- trial-2376 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 16:53:19.600721 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:53:19.618373 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:53:19.646267 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:53:19.698499 tst rrc_idle_mo_ping.py: using MSISDN 7815 16:53:19.814035 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7815', subscriber_id=0} 16:53:19.925803 run srsepc_10.42.42.118: Starting srsepc 16:53:20.573750 run rm-remote-dir(pid=26750): Launched 16:53:21.773499 run rm-remote-dir(pid=26750): Terminated: ok {rc=0} 16:53:22.133660 run mk-remote-dir(pid=26753): Launched 16:53:23.329133 run mk-remote-dir(pid=26753): Terminated: ok {rc=0} 16:53:23.628910 run scp-inst-to-remote(pid=26754): Launched 16:53:25.870856 run scp-inst-to-remote(pid=26754): Terminated: ok {rc=0} 16:53:26.229691 run rm-remote-dir(pid=26756): Launched 16:53:27.431392 run rm-remote-dir(pid=26756): Terminated: ok {rc=0} 16:53:27.786222 run mk-remote-dir(pid=26757): Launched 16:53:28.993523 run mk-remote-dir(pid=26757): Terminated: ok {rc=0} 16:53:29.299932 run scp-cfg-to-remote(pid=26758): Launched 16:53:30.507024 run scp-cfg-to-remote(pid=26758): Terminated: ok {rc=0} 16:53:30.820630 run scp-db-to-remote(pid=26760): Launched 16:53:32.158806 run scp-db-to-remote(pid=26760): Terminated: ok {rc=0} 16:53:32.347656 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:53:32.750349 run patchelf(pid=26762): Launched 16:53:34.016099 run patchelf(pid=26762): Terminated: ok {rc=0} 16:53:34.160177 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:53:34.504055 run setcap-netadm(pid=26763): Launched 16:53:35.762243 run setcap-netadm(pid=26763): Terminated: ok {rc=0} 16:53:36.131074 run srsepc(pid=26764): Launched 16:53:36.307011 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:53:37.598281 run rm-remote-dir(pid=26765): Launched 16:53:37.910997 run srsepc(pid=26764): ERR: Terminated: ERROR {rc=127} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26764)] 16:53:38.066956 run srsepc(pid=26764): stdout: | (launched: 2022-12-10_16:53:36.060669) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:53:38.215646 run srsepc(pid=26764): stderr: | (launched: 2022-12-10_16:53:36.109988) | Connection to 10.42.42.116 closed. 16:53:38.365218 run srsepc(pid=26764): stdout: | (launched: 2022-12-10_16:53:36.060669) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:53:38.507842 run srsepc(pid=26764): stderr: | (launched: 2022-12-10_16:53:36.109988) | Connection to 10.42.42.116 closed. 16:53:38.677487 run rm-remote-dir(pid=26765): Terminating (SIGINT) 16:53:38.874024 run rm-remote-dir(pid=26765): Terminated: ok {rc=0} 16:53:39.016892 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=26764): Process ended prematurely: srsepc(pid=26764) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26764)] [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 16:53:39.027702 tst rrc_idle_mo_ping.py:16: Test FAILED (19.4 sec) 16:53:39.116534 run scp-back-log(pid=26766): Launched 16:53:40.236336 run scp-back-log(pid=26766): ERR: Terminated: ERROR {rc=1} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26766)] 16:53:40.300262 run scp-back-log(pid=26766): stdout: | (launched: 2022-12-10_16:53:39.079532) 16:53:40.365750 run scp-back-log(pid=26766): stderr: | (launched: 2022-12-10_16:53:39.100875) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:53:40.439622 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26766): launch_sync(): local process exited with status 1 [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26766)]') ---------------------------------------------- trial-2376 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 16:53:40.487741 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:53:40.505127 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:53:40.528539 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:53:40.578523 tst rrc_idle_mt_ping.py: using MSISDN 7816 16:53:40.701992 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7816', subscriber_id=0} 16:53:40.817286 run srsepc_10.42.42.118: Starting srsepc 16:53:41.489442 run rm-remote-dir(pid=26768): Launched 16:53:42.681426 run rm-remote-dir(pid=26768): Terminated: ok {rc=0} 16:53:43.041471 run mk-remote-dir(pid=26769): Launched 16:53:44.232537 run mk-remote-dir(pid=26769): Terminated: ok {rc=0} 16:53:44.539206 run scp-inst-to-remote(pid=26770): Launched 16:53:46.730517 run scp-inst-to-remote(pid=26770): Terminated: ok {rc=0} 16:53:47.083316 run rm-remote-dir(pid=26777): Launched 16:53:48.285990 run rm-remote-dir(pid=26777): Terminated: ok {rc=0} 16:53:48.624446 run mk-remote-dir(pid=26778): Launched 16:53:49.804243 run mk-remote-dir(pid=26778): Terminated: ok {rc=0} 16:53:50.093597 run scp-cfg-to-remote(pid=26779): Launched 16:53:51.270835 run scp-cfg-to-remote(pid=26779): Terminated: ok {rc=0} 16:53:51.557993 run scp-db-to-remote(pid=26781): Launched 16:53:52.738407 run scp-db-to-remote(pid=26781): Terminated: ok {rc=0} 16:53:52.870835 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:53:53.182077 run patchelf(pid=26783): Launched 16:53:54.359356 run patchelf(pid=26783): Terminated: ok {rc=0} 16:53:54.492316 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:53:54.802961 run setcap-netadm(pid=26784): Launched 16:53:55.978915 run setcap-netadm(pid=26784): Terminated: ok {rc=0} 16:53:56.305010 run srsepc(pid=26785): Launched 16:53:56.419242 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:53:57.531516 run rm-remote-dir(pid=26786): Launched 16:53:57.708934 run srsepc(pid=26785): ERR: Terminated: ERROR {rc=127} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26785)] 16:53:57.843907 run srsepc(pid=26785): stdout: | (launched: 2022-12-10_16:53:56.247695) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:53:57.979538 run srsepc(pid=26785): stderr: | (launched: 2022-12-10_16:53:56.293958) | Connection to 10.42.42.116 closed. 16:53:58.115151 run srsepc(pid=26785): stdout: | (launched: 2022-12-10_16:53:56.247695) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:53:58.244332 run srsepc(pid=26785): stderr: | (launched: 2022-12-10_16:53:56.293958) | Connection to 10.42.42.116 closed. 16:53:58.397532 run rm-remote-dir(pid=26786): Terminating (SIGINT) 16:53:58.575745 run rm-remote-dir(pid=26786): Terminated: ok {rc=0} 16:53:58.704759 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=26785): Process ended prematurely: srsepc(pid=26785) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26785)] [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 16:53:58.714734 tst rrc_idle_mt_ping.py:16: Test FAILED (18.2 sec) 16:53:58.793231 run scp-back-log(pid=26787): Launched 16:53:59.870230 run scp-back-log(pid=26787): ERR: Terminated: ERROR {rc=1} [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26787)] 16:53:59.931377 run scp-back-log(pid=26787): stdout: | (launched: 2022-12-10_16:53:58.761981) 16:53:59.993947 run scp-back-log(pid=26787): stderr: | (launched: 2022-12-10_16:53:58.781984) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:54:00.064211 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26787): launch_sync(): local process exited with status 1 [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26787)]') --------------------------------------------------------------------- trial-2376 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 16:54:00.195878 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:00.200771 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 16:54:00.242275 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 16:54:00.269038 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 16:54:00.321838 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 16:54:00.365461 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 16:54:00.392132 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 16:54:00.947576 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 16:54:00.953784 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:00.965287 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 16:54:01.007569 tst handover.py: using LAC 29329 16:54:01.132068 tst handover.py: using RAC 4 16:54:01.260749 tst handover.py: using CellId 29329 16:54:01.426312 tst handover.py: using BVCI 29330 16:54:01.581860 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 16:54:01.619442 tst handover.py: using LAC 29330 16:54:01.742214 tst handover.py: using RAC 5 16:54:01.862497 tst handover.py: using CellId 29330 16:54:01.993718 tst handover.py: using BVCI 29331 16:54:02.141961 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:02.154160 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:02.166119 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:02.178953 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:02.192476 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:02.204132 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 16:54:02.324452 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 16:54:02.443222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:02.943551 run create_hlr_db(pid=26792): Launched 16:54:04.123584 run create_hlr_db(pid=26792): Terminated: ok {rc=0} 16:54:04.462720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26794): Launched 16:54:04.782984 run osmo-hlr_10.42.42.2(pid=26795): Launched 16:54:04.906436 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:05.429600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26797): Launched 16:54:05.733558 run osmo-stp_10.42.42.5(pid=26798): Launched 16:54:05.849799 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:06.400129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26800): Launched 16:54:06.703120 run osmo-msc_10.42.42.6(pid=26801): Launched 16:54:06.871822 run osmo-stp_10.42.42.5(pid=26798): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26798)] 16:54:07.000219 run osmo-stp_10.42.42.5(pid=26798): stdout: | (launched: 2022-12-10_16:54:05.677638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:07.128652 run osmo-stp_10.42.42.5(pid=26798): stderr: | [0;m[38;5;43m20221210165405847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165405848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165405849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165405849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165405850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165405850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165405850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:07.254856 run osmo-stp_10.42.42.5(pid=26798): stdout: | (launched: 2022-12-10_16:54:05.677638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:07.375234 run osmo-stp_10.42.42.5(pid=26798): stderr: | [0;m[38;5;43m20221210165405847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165405848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165405849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165405849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165405850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165405850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165405850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:07.518959 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26798): Process ended prematurely: osmo-stp_10.42.42.5(pid=26798) [trial-2376↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26798)] [trial-2376↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 16:54:07.527423 tst handover.py:18: Test FAILED (6.6 sec) 16:54:07.553632 run osmo-hlr_10.42.42.2(pid=26795): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26795)] 16:54:07.601688 run osmo-hlr_10.42.42.2(pid=26795): stdout: | (launched: 2022-12-10_16:54:04.724316) 16:54:07.651288 run osmo-hlr_10.42.42.2(pid=26795): stderr: | [0;m[1;31m20221210165404915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165404915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165404915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165404915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165404915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165404915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165404928 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165404938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165404938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165404938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:07.721520 run osmo-msc_10.42.42.6(pid=26801): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26801)] 16:54:07.769445 run osmo-msc_10.42.42.6(pid=26801): stdout: | (launched: 2022-12-10_16:54:06.647437) 16:54:07.818950 run osmo-msc_10.42.42.6(pid=26801): stderr: | [0;m[38;5;43m20221210165406917 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165406918 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8374660c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165406918 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165406918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165406918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165406918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165406920 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165406920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165406920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165406920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:07.868647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26794): Terminating (SIGTERM) 16:54:07.908499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26797): Terminating (SIGTERM) 16:54:07.948494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26800): Terminating (SIGTERM) 16:54:07.988727 --- ParallelTerminationStrategy: PID 26794 died... 16:54:08.007825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26794): Terminated: ok {rc=0} 16:54:08.052474 --- ParallelTerminationStrategy: PID 26797 died... 16:54:08.070941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26797): Terminated: ok {rc=0} 16:54:08.115206 --- ParallelTerminationStrategy: PID 26800 died... 16:54:08.133747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26800): Terminated: ok {rc=0} 16:54:08.217785 bus /sierra_3: Setting Powered False 16:54:09.313204 bus /sierra_3: Setting Powered False 16:54:10.428039 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 16:54:11.671847 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:11.676882 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 16:54:11.717148 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 16:54:11.744510 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 16:54:11.796146 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 16:54:11.835761 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 16:54:11.862298 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 16:54:12.415137 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 16:54:12.420328 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:12.431277 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 16:54:12.469711 tst handover.py: using LAC 29331 16:54:12.588624 tst handover.py: using RAC 6 16:54:12.708748 tst handover.py: using CellId 29331 16:54:12.828383 tst handover.py: using BVCI 29332 16:54:12.940289 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 16:54:12.974857 tst handover.py: using LAC 29332 16:54:13.093420 tst handover.py: using RAC 7 16:54:13.212873 tst handover.py: using CellId 29332 16:54:13.333342 tst handover.py: using BVCI 29333 16:54:13.443288 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:13.454238 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:13.464902 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:13.475851 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:13.486924 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:13.497853 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 16:54:13.615307 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 16:54:13.730634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:14.175802 run create_hlr_db(pid=26806): Launched 16:54:14.299208 bus /sierra_2: Setting Powered False 16:54:15.359635 run create_hlr_db(pid=26806): Terminated: ok {rc=0} 16:54:15.774748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26808): Launched 16:54:16.115704 run osmo-hlr_10.42.42.2(pid=26809): Launched 16:54:16.246092 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:16.919067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26811): Launched 16:54:17.309527 run osmo-stp_10.42.42.5(pid=26812): Launched 16:54:17.432830 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:17.997415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26814): Launched 16:54:18.324210 run osmo-msc_10.42.42.6(pid=26815): Launched 16:54:18.504119 run osmo-stp_10.42.42.5(pid=26812): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26812)] 16:54:18.639696 run osmo-stp_10.42.42.5(pid=26812): stdout: | (launched: 2022-12-10_16:54:17.249498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:18.776216 run osmo-stp_10.42.42.5(pid=26812): stderr: | [0;m[38;5;43m20221210165417443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165417443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165417443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165417444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165417444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165417444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165417444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:18.912286 run osmo-stp_10.42.42.5(pid=26812): stdout: | (launched: 2022-12-10_16:54:17.249498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:19.041774 run osmo-stp_10.42.42.5(pid=26812): stderr: | [0;m[38;5;43m20221210165417443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165417443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165417443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165417444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165417444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165417444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165417444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:19.196190 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26812): Process ended prematurely: osmo-stp_10.42.42.5(pid=26812) [trial-2376↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26812)] [trial-2376↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 16:54:19.205201 tst handover.py:18: Test FAILED (6.8 sec) 16:54:19.232783 run osmo-hlr_10.42.42.2(pid=26809): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26809)] 16:54:19.282956 run osmo-hlr_10.42.42.2(pid=26809): stdout: | (launched: 2022-12-10_16:54:16.054853) 16:54:19.334804 run osmo-hlr_10.42.42.2(pid=26809): stderr: | [0;m[1;31m20221210165416420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165416420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165416420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165416420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165416420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165416420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165416439 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165416447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165416447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165416447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:19.407472 run osmo-msc_10.42.42.6(pid=26815): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26815)] 16:54:19.457468 run osmo-msc_10.42.42.6(pid=26815): stdout: | (launched: 2022-12-10_16:54:18.264748) 16:54:19.509249 run osmo-msc_10.42.42.6(pid=26815): stderr: | [0;m[38;5;43m20221210165418586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165418586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc7f455c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165418587 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165418587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165418587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165418587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165418589 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165418589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165418589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165418589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:19.561162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26808): Terminating (SIGTERM) 16:54:19.602970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26811): Terminating (SIGTERM) 16:54:19.645159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26814): Terminating (SIGTERM) 16:54:19.687666 --- ParallelTerminationStrategy: PID 26808 died... 16:54:19.707788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26808): Terminated: ok {rc=0} 16:54:19.754651 --- ParallelTerminationStrategy: PID 26811 died... 16:54:19.774378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26811): Terminated: ok {rc=0} 16:54:19.821240 --- ParallelTerminationStrategy: PID 26814 died... 16:54:19.841069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26814): Terminated: ok {rc=0} 16:54:19.929653 bus /sierra_3: Setting Powered False 16:54:21.029536 bus /sierra_3: Setting Powered False 16:54:22.147644 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 16:54:23.390581 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:23.395800 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 16:54:23.449348 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 16:54:23.476216 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 16:54:23.530580 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 16:54:23.586719 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 16:54:23.614136 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 16:54:24.160886 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 16:54:24.166047 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:24.176863 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:54:24.215392 tst handover.py: using LAC 29333 16:54:24.335553 tst handover.py: using RAC 8 16:54:24.456404 tst handover.py: using CellId 29333 16:54:24.577434 tst handover.py: using BVCI 29334 16:54:24.687311 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:54:24.735847 tst handover.py: using LAC 29334 16:54:24.859920 tst handover.py: using RAC 9 16:54:24.987273 tst handover.py: using CellId 29334 16:54:25.105533 tst handover.py: using BVCI 29335 16:54:25.225344 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:25.236896 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:25.248323 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:25.260052 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:25.271678 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:25.283233 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:54:25.398034 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:54:25.512612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:25.958334 run create_hlr_db(pid=26820): Launched 16:54:26.082519 bus /sierra_2: Setting Powered False 16:54:27.142867 run create_hlr_db(pid=26820): Terminated: ok {rc=0} 16:54:27.558701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26822): Launched 16:54:27.883854 run osmo-hlr_10.42.42.2(pid=26823): Launched 16:54:28.008795 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:28.539310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26825): Launched 16:54:28.862787 run osmo-stp_10.42.42.5(pid=26826): Launched 16:54:28.987212 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:29.545498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26828): Launched 16:54:29.870388 run osmo-msc_10.42.42.6(pid=26829): Launched 16:54:30.051670 run osmo-stp_10.42.42.5(pid=26826): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26826)] 16:54:30.188608 run osmo-stp_10.42.42.5(pid=26826): stdout: | (launched: 2022-12-10_16:54:28.803454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:30.326191 run osmo-stp_10.42.42.5(pid=26826): stderr: | [0;m[38;5;43m20221210165428993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165428993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165428993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165428994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165428994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165428994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165428994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:30.462784 run osmo-stp_10.42.42.5(pid=26826): stdout: | (launched: 2022-12-10_16:54:28.803454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:30.592623 run osmo-stp_10.42.42.5(pid=26826): stderr: | [0;m[38;5;43m20221210165428993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165428993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165428993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165428994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165428994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165428994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165428994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:30.747406 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26826): Process ended prematurely: osmo-stp_10.42.42.5(pid=26826) [trial-2376↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26826)] [trial-2376↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 16:54:30.756156 tst handover.py:18: Test FAILED (6.6 sec) 16:54:30.784690 run osmo-hlr_10.42.42.2(pid=26823): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26823)] 16:54:30.846355 run osmo-hlr_10.42.42.2(pid=26823): stdout: | (launched: 2022-12-10_16:54:27.824246) 16:54:30.913934 run osmo-hlr_10.42.42.2(pid=26823): stderr: | [0;m[1;31m20221210165428024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165428024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165428024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165428024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165428024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165428024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165428072 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165428081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165428081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165428081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:30.987629 run osmo-msc_10.42.42.6(pid=26829): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26829)] 16:54:31.047179 run osmo-msc_10.42.42.6(pid=26829): stdout: | (launched: 2022-12-10_16:54:29.810602) 16:54:31.112412 run osmo-msc_10.42.42.6(pid=26829): stderr: | [0;m[38;5;43m20221210165430131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165430131 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0e870cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165430131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165430131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165430132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165430132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165430134 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165430134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165430134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165430134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:31.177383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26822): Terminating (SIGTERM) 16:54:31.230002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26825): Terminating (SIGTERM) 16:54:31.286471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26828): Terminating (SIGTERM) 16:54:31.340688 --- ParallelTerminationStrategy: PID 26822 died... 16:54:31.365298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26822): Terminated: ok {rc=0} 16:54:31.417423 --- ParallelTerminationStrategy: PID 26825 died... 16:54:31.436777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26825): Terminated: ok {rc=0} 16:54:31.484252 --- ParallelTerminationStrategy: PID 26828 died... 16:54:31.503551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26828): Terminated: ok {rc=0} 16:54:31.596102 bus /sierra_3: Setting Powered False 16:54:32.703336 bus /sierra_3: Setting Powered False 16:54:33.820771 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:54:35.082607 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:35.087575 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:54:35.137034 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:54:35.163452 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:54:35.219061 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:54:35.268167 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:54:35.294582 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:54:35.842339 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:54:35.847759 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:35.858958 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:54:35.896620 tst handover.py: using LAC 29335 16:54:36.014441 tst handover.py: using RAC 10 16:54:36.133284 tst handover.py: using CellId 29335 16:54:36.252760 tst handover.py: using BVCI 29336 16:54:36.371714 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:54:36.417129 tst handover.py: using LAC 29336 16:54:36.542435 tst handover.py: using RAC 11 16:54:36.668263 tst handover.py: using CellId 29336 16:54:36.794885 tst handover.py: using BVCI 29337 16:54:36.913357 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:36.925222 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:36.936705 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:36.948723 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:36.960621 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:36.972580 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:54:37.087914 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:54:37.208603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:37.654297 run create_hlr_db(pid=26834): Launched 16:54:37.778957 bus /sierra_2: Setting Powered False 16:54:38.839308 run create_hlr_db(pid=26834): Terminated: ok {rc=0} 16:54:39.255494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26836): Launched 16:54:39.580350 run osmo-hlr_10.42.42.2(pid=26837): Launched 16:54:39.704815 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:40.236673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26839): Launched 16:54:40.559382 run osmo-stp_10.42.42.5(pid=26840): Launched 16:54:40.683266 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:41.243935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26842): Launched 16:54:41.567917 run osmo-msc_10.42.42.6(pid=26843): Launched 16:54:41.748844 run osmo-stp_10.42.42.5(pid=26840): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26840)] 16:54:41.885223 run osmo-stp_10.42.42.5(pid=26840): stdout: | (launched: 2022-12-10_16:54:40.500164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:42.022777 run osmo-stp_10.42.42.5(pid=26840): stderr: | [0;m[38;5;43m20221210165440691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165440691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165440691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165440692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165440692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165440692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165440692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:42.158960 run osmo-stp_10.42.42.5(pid=26840): stdout: | (launched: 2022-12-10_16:54:40.500164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:42.288244 run osmo-stp_10.42.42.5(pid=26840): stderr: | [0;m[38;5;43m20221210165440691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165440691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165440691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165440692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165440692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165440692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165440692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:42.442994 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26840): Process ended prematurely: osmo-stp_10.42.42.5(pid=26840) [trial-2376↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26840)] [trial-2376↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 16:54:42.452038 tst handover.py:18: Test FAILED (6.6 sec) 16:54:42.480306 run osmo-hlr_10.42.42.2(pid=26837): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26837)] 16:54:42.530373 run osmo-hlr_10.42.42.2(pid=26837): stdout: | (launched: 2022-12-10_16:54:39.521056) 16:54:42.582418 run osmo-hlr_10.42.42.2(pid=26837): stderr: | [0;m[1;31m20221210165439720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165439720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165439720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165439720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165439720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165439720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165439731 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165439739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165439739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165439739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:42.654431 run osmo-msc_10.42.42.6(pid=26843): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26843)] 16:54:42.704421 run osmo-msc_10.42.42.6(pid=26843): stdout: | (launched: 2022-12-10_16:54:41.508390) 16:54:42.756267 run osmo-msc_10.42.42.6(pid=26843): stderr: | [0;m[38;5;43m20221210165441830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165441830 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe806153c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165441830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165441830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165441830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165441830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165441832 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165441833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165441833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165441833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:42.808093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26836): Terminating (SIGTERM) 16:54:42.850136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26839): Terminating (SIGTERM) 16:54:42.892413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26842): Terminating (SIGTERM) 16:54:42.935533 --- ParallelTerminationStrategy: PID 26836 died... 16:54:42.955579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26836): Terminated: ok {rc=0} 16:54:43.002594 --- ParallelTerminationStrategy: PID 26839 died... 16:54:43.022315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26839): Terminated: ok {rc=0} 16:54:43.069499 --- ParallelTerminationStrategy: PID 26842 died... 16:54:43.089104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26842): Terminated: ok {rc=0} 16:54:43.178178 bus /sierra_3: Setting Powered False 16:54:44.278565 bus /sierra_3: Setting Powered False 16:54:45.394863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:54:46.712241 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:46.721484 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:54:46.794227 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:54:46.828858 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:54:46.884294 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:54:46.957809 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:54:46.997260 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:54:47.520481 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:54:47.526259 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:54:47.537981 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:54:47.578607 tst handover.py: using LAC 29337 16:54:47.706730 tst handover.py: using RAC 12 16:54:47.835003 tst handover.py: using CellId 29337 16:54:47.962436 tst handover.py: using BVCI 29338 16:54:48.082476 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:54:48.139280 tst handover.py: using LAC 29338 16:54:48.265967 tst handover.py: using RAC 13 16:54:48.391288 tst handover.py: using CellId 29338 16:54:48.512068 tst handover.py: using BVCI 29339 16:54:48.622809 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:54:48.634162 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:54:48.645282 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:54:48.656509 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:54:48.667768 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:54:48.679020 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:54:48.796428 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:54:48.916494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:49.390250 run create_hlr_db(pid=26848): Launched 16:54:49.513837 bus /sierra_2: Setting Powered False 16:54:50.577414 run create_hlr_db(pid=26848): Terminated: ok {rc=0} 16:54:51.001442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26850): Launched 16:54:51.325649 run osmo-hlr_10.42.42.2(pid=26851): Launched 16:54:51.450495 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:51.982517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26853): Launched 16:54:52.306453 run osmo-stp_10.42.42.5(pid=26854): Launched 16:54:52.430072 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:52.986422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26856): Launched 16:54:53.312341 run osmo-msc_10.42.42.6(pid=26857): Launched 16:54:53.491683 run osmo-stp_10.42.42.5(pid=26854): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26854)] 16:54:53.627135 run osmo-stp_10.42.42.5(pid=26854): stdout: | (launched: 2022-12-10_16:54:52.247365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:53.763198 run osmo-stp_10.42.42.5(pid=26854): stderr: | [0;m[38;5;43m20221210165452438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165452438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165452438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165452439 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165452439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165452439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165452439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:53.898902 run osmo-stp_10.42.42.5(pid=26854): stdout: | (launched: 2022-12-10_16:54:52.247365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:54.028500 run osmo-stp_10.42.42.5(pid=26854): stderr: | [0;m[38;5;43m20221210165452438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165452438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165452438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165452439 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165452439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165452439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165452439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:54.182997 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26854): Process ended prematurely: osmo-stp_10.42.42.5(pid=26854) [trial-2376↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26854)] [trial-2376↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 16:54:54.191683 tst handover.py:18: Test FAILED (6.7 sec) 16:54:54.219615 run osmo-hlr_10.42.42.2(pid=26851): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26851)] 16:54:54.270483 run osmo-hlr_10.42.42.2(pid=26851): stdout: | (launched: 2022-12-10_16:54:51.266821) 16:54:54.322990 run osmo-hlr_10.42.42.2(pid=26851): stderr: | [0;m[1;31m20221210165451465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165451465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165451465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165451465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165451465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165451465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165451478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165451488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165451488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165451488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:54.395986 run osmo-msc_10.42.42.6(pid=26857): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26857)] 16:54:54.446484 run osmo-msc_10.42.42.6(pid=26857): stdout: | (launched: 2022-12-10_16:54:53.252871) 16:54:54.498627 run osmo-msc_10.42.42.6(pid=26857): stderr: | [0;m[38;5;43m20221210165453574 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165453574 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f537513dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165453574 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165453574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165453574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165453575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165453576 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165453577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165453577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165453577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:54.551787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26850): Terminating (SIGTERM) 16:54:54.594290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26853): Terminating (SIGTERM) 16:54:54.636513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26856): Terminating (SIGTERM) 16:54:54.679034 --- ParallelTerminationStrategy: PID 26850 died... 16:54:54.699175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26850): Terminated: ok {rc=0} 16:54:54.746242 --- ParallelTerminationStrategy: PID 26853 died... 16:54:54.765908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26853): Terminated: ok {rc=0} 16:54:54.812805 --- ParallelTerminationStrategy: PID 26856 died... 16:54:54.832891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26856): Terminated: ok {rc=0} 16:54:54.922205 bus /sierra_3: Setting Powered False 16:54:56.019024 bus /sierra_3: Setting Powered False 16:54:57.133661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 16:54:58.398579 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:58.403580 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:54:58.445462 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:54:58.472497 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:54:58.527090 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:54:58.570738 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:54:58.598272 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:54:59.142726 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 16:54:59.148278 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:54:59.159346 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 16:54:59.198843 tst handover.py: using LAC 29339 16:54:59.320048 tst handover.py: using RAC 14 16:54:59.440640 tst handover.py: using CellId 29339 16:54:59.559159 tst handover.py: using BVCI 29340 16:54:59.670102 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 16:54:59.705488 tst handover.py: using LAC 29340 16:54:59.833386 tst handover.py: using RAC 15 16:54:59.962314 tst handover.py: using CellId 29340 16:55:00.081655 tst handover.py: using BVCI 29341 16:55:00.191881 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:00.202996 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:00.214066 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:00.225272 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:00.236426 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:00.247476 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 16:55:00.365196 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 16:55:00.484141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:00.969475 run create_hlr_db(pid=26862): Launched 16:55:01.137652 bus /sierra_2: Setting Powered False 16:55:02.197356 run create_hlr_db(pid=26862): Terminated: ok {rc=0} 16:55:02.614468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Launched 16:55:02.938462 run osmo-hlr_10.42.42.2(pid=26868): Launched 16:55:03.061954 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:03.592842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Launched 16:55:03.915322 run osmo-stp_10.42.42.5(pid=26871): Launched 16:55:04.039163 run osmo-msc_10.42.42.6: Starting osmo-msc 16:55:04.596219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26873): Launched 16:55:04.920460 run osmo-msc_10.42.42.6(pid=26874): Launched 16:55:05.102108 run osmo-stp_10.42.42.5(pid=26871): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] 16:55:05.238838 run osmo-stp_10.42.42.5(pid=26871): stdout: | (launched: 2022-12-10_16:55:03.855859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:05.376373 run osmo-stp_10.42.42.5(pid=26871): stderr: | [0;m[38;5;43m20221210165504050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165504050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165504050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165504051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165504051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165504051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165504051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:05.512421 run osmo-stp_10.42.42.5(pid=26871): stdout: | (launched: 2022-12-10_16:55:03.855859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:05.641741 run osmo-stp_10.42.42.5(pid=26871): stderr: | [0;m[38;5;43m20221210165504050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165504050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165504050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165504051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165504051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165504051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165504051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:05.796154 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26871): Process ended prematurely: osmo-stp_10.42.42.5(pid=26871) [trial-2376↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] [trial-2376↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 16:55:05.805058 tst handover.py:18: Test FAILED (6.6 sec) 16:55:05.833243 run osmo-hlr_10.42.42.2(pid=26868): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26868)] 16:55:05.883601 run osmo-hlr_10.42.42.2(pid=26868): stdout: | (launched: 2022-12-10_16:55:02.879354) 16:55:05.935680 run osmo-hlr_10.42.42.2(pid=26868): stderr: | [0;m[1;31m20221210165503077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165503078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165503078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165503078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165503078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165503078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165503090 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165503100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165503100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165503100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:06.007699 run osmo-msc_10.42.42.6(pid=26874): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26874)] 16:55:06.057604 run osmo-msc_10.42.42.6(pid=26874): stdout: | (launched: 2022-12-10_16:55:04.860638) 16:55:06.109310 run osmo-msc_10.42.42.6(pid=26874): stderr: | [0;m[38;5;43m20221210165505183 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165505183 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9bb9f88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165505183 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165505183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165505183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165505183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165505185 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165505186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165505186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165505186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:55:06.161366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Terminating (SIGTERM) 16:55:06.203102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Terminating (SIGTERM) 16:55:06.244998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26873): Terminating (SIGTERM) 16:55:06.287453 --- ParallelTerminationStrategy: PID 26867 died... 16:55:06.307333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Terminated: ok {rc=0} 16:55:06.354440 --- ParallelTerminationStrategy: PID 26870 died... 16:55:06.373981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Terminated: ok {rc=0} 16:55:06.420774 --- ParallelTerminationStrategy: PID 26873 died... 16:55:06.440434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26873): Terminated: ok {rc=0} 16:55:06.529180 bus /sierra_3: Setting Powered False 16:55:07.627591 bus /sierra_3: Setting Powered False 16:55:08.744009 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 16:55:09.996362 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:10.001487 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:55:10.054656 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:55:10.081950 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:55:10.138147 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:55:10.191910 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:55:10.218730 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:55:10.768683 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 16:55:10.774124 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:10.785497 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:55:10.828717 tst handover.py: using LAC 29341 16:55:10.955780 tst handover.py: using RAC 16 16:55:11.080472 tst handover.py: using CellId 29341 16:55:11.206861 tst handover.py: using BVCI 29342 16:55:11.323961 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:55:11.372268 tst handover.py: using LAC 29342 16:55:11.498223 tst handover.py: using RAC 17 16:55:11.624431 tst handover.py: using CellId 29342 16:55:11.749373 tst handover.py: using BVCI 29343 16:55:11.866561 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:11.877992 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:11.889490 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:11.900853 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:11.912887 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:11.924775 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:55:12.039786 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:55:12.154434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:12.627468 run create_hlr_db(pid=26879): Launched 16:55:12.750535 bus /sierra_2: Setting Powered False 16:55:13.814415 run create_hlr_db(pid=26879): Terminated: ok {rc=0} 16:55:14.237433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26881): Launched 16:55:14.561057 run osmo-hlr_10.42.42.2(pid=26882): Launched 16:55:14.685317 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:15.216232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26884): Launched 16:55:15.538804 run osmo-stp_10.42.42.5(pid=26885): Launched 16:55:15.662423 run osmo-msc_10.42.42.6: Starting osmo-msc 16:55:16.233716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26887): Launched 16:55:16.579479 run osmo-msc_10.42.42.6(pid=26888): Launched 16:55:17.106194 run osmo-stp_10.42.42.5(pid=26885): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26885)] 16:55:17.353935 run osmo-stp_10.42.42.5(pid=26885): stdout: | (launched: 2022-12-10_16:55:15.479805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:17.490670 run osmo-stp_10.42.42.5(pid=26885): stderr: | [0;m[38;5;43m20221210165515671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165515671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165515672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165515672 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165515672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165515672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165515673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:17.626552 run osmo-stp_10.42.42.5(pid=26885): stdout: | (launched: 2022-12-10_16:55:15.479805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:17.756168 run osmo-stp_10.42.42.5(pid=26885): stderr: | [0;m[38;5;43m20221210165515671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165515671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165515672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165515672 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165515672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165515672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165515673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:17.911168 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26885): Process ended prematurely: osmo-stp_10.42.42.5(pid=26885) [trial-2376↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26885)] [trial-2376↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 16:55:17.920054 tst handover.py:18: Test FAILED (7.1 sec) 16:55:17.948573 run osmo-hlr_10.42.42.2(pid=26882): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26882)] 16:55:17.999636 run osmo-hlr_10.42.42.2(pid=26882): stdout: | (launched: 2022-12-10_16:55:14.501738) 16:55:18.052316 run osmo-hlr_10.42.42.2(pid=26882): stderr: | [0;m[1;31m20221210165514700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165514700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165514700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165514700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165514700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165514700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165514713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165514721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165514721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165514721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:18.125916 run osmo-msc_10.42.42.6(pid=26888): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26888)] 16:55:18.176871 run osmo-msc_10.42.42.6(pid=26888): stdout: | (launched: 2022-12-10_16:55:16.514731) 16:55:18.229518 run osmo-msc_10.42.42.6(pid=26888): stderr: | [0;m[38;5;43m20221210165517021 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165517022 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71fc607c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165517022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165517022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165517023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165517023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165517034 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165517034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165517034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165517034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:55:18.282788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26881): Terminating (SIGTERM) 16:55:18.325835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26884): Terminating (SIGTERM) 16:55:18.368629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26887): Terminating (SIGTERM) 16:55:18.411608 --- ParallelTerminationStrategy: PID 26881 died... 16:55:18.431770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26881): Terminated: ok {rc=0} 16:55:18.479124 --- ParallelTerminationStrategy: PID 26884 died... 16:55:18.498846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26884): Terminated: ok {rc=0} 16:55:18.546164 --- ParallelTerminationStrategy: PID 26887 died... 16:55:18.566020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26887): Terminated: ok {rc=0} 16:55:18.654984 bus /sierra_3: Setting Powered False 16:55:19.754793 bus /sierra_3: Setting Powered False 16:55:20.872090 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 16:55:22.135400 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:22.141189 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:55:22.196057 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:55:22.223192 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:55:22.277820 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:55:22.332688 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:55:22.360126 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:55:22.909650 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 16:55:22.916093 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:22.928178 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:55:22.968233 tst handover.py: using LAC 29343 16:55:23.088012 tst handover.py: using RAC 18 16:55:23.211846 tst handover.py: using CellId 29343 16:55:23.331318 tst handover.py: using BVCI 29344 16:55:23.442756 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:55:23.489826 tst handover.py: using LAC 29344 16:55:23.607683 tst handover.py: using RAC 19 16:55:23.725120 tst handover.py: using CellId 29344 16:55:23.843585 tst handover.py: using BVCI 29345 16:55:23.953363 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:23.964201 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:23.974951 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:23.985955 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:23.996941 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:24.007893 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:55:24.121234 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:55:24.240321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:24.712915 run create_hlr_db(pid=26893): Launched 16:55:24.836764 bus /sierra_2: Setting Powered False 16:55:25.897161 run create_hlr_db(pid=26893): Terminated: ok {rc=0} 16:55:26.295333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26895): Launched 16:55:26.600813 run osmo-hlr_10.42.42.2(pid=26896): Launched 16:55:26.716561 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:27.213844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26898): Launched 16:55:27.518060 run osmo-stp_10.42.42.5(pid=26899): Launched 16:55:27.633151 run osmo-msc_10.42.42.6: Starting osmo-msc 16:55:28.157030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26901): Launched 16:55:28.461928 run osmo-msc_10.42.42.6(pid=26902): Launched 16:55:28.631291 run osmo-stp_10.42.42.5(pid=26899): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26899)] 16:55:28.760198 run osmo-stp_10.42.42.5(pid=26899): stdout: | (launched: 2022-12-10_16:55:27.461781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:28.888338 run osmo-stp_10.42.42.5(pid=26899): stderr: | [0;m[38;5;43m20221210165527632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165527632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165527632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165527633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165527633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165527633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165527633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:29.014908 run osmo-stp_10.42.42.5(pid=26899): stdout: | (launched: 2022-12-10_16:55:27.461781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:29.136016 run osmo-stp_10.42.42.5(pid=26899): stderr: | [0;m[38;5;43m20221210165527632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165527632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165527632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165527633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165527633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165527633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165527633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:29.280611 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26899): Process ended prematurely: osmo-stp_10.42.42.5(pid=26899) [trial-2376↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26899)] [trial-2376↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 16:55:29.289099 tst handover.py:18: Test FAILED (6.4 sec) 16:55:29.315468 run osmo-hlr_10.42.42.2(pid=26896): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26896)] 16:55:29.363894 run osmo-hlr_10.42.42.2(pid=26896): stdout: | (launched: 2022-12-10_16:55:26.544266) 16:55:29.414112 run osmo-hlr_10.42.42.2(pid=26896): stderr: | [0;m[1;31m20221210165526724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165526724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165526724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165526724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165526724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165526724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165526737 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165526747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165526747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165526748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:29.484073 run osmo-msc_10.42.42.6(pid=26902): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26902)] 16:55:29.532361 run osmo-msc_10.42.42.6(pid=26902): stdout: | (launched: 2022-12-10_16:55:28.406172) 16:55:29.582227 run osmo-msc_10.42.42.6(pid=26902): stderr: | [0;m[38;5;43m20221210165528677 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165528678 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f33e8f16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165528678 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165528678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165528678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165528678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165528680 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165528680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165528680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165528680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:55:29.632425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26895): Terminating (SIGTERM) 16:55:29.672812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26898): Terminating (SIGTERM) 16:55:29.713202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26901): Terminating (SIGTERM) 16:55:29.754116 --- ParallelTerminationStrategy: PID 26895 died... 16:55:29.773485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26895): Terminated: ok {rc=0} 16:55:29.818632 --- ParallelTerminationStrategy: PID 26898 died... 16:55:29.837521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26898): Terminated: ok {rc=0} 16:55:29.882196 --- ParallelTerminationStrategy: PID 26901 died... 16:55:29.901060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26901): Terminated: ok {rc=0} 16:55:29.985518 bus /sierra_3: Setting Powered False 16:55:31.090535 bus /sierra_3: Setting Powered False 16:55:32.217063 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 16:55:33.478853 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:33.484399 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 16:55:33.523372 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 16:55:33.550795 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 16:55:33.603994 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 16:55:33.641820 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 16:55:33.669497 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 16:55:34.216629 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 16:55:34.222147 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:34.233243 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 16:55:34.267815 tst handover.py: using LAC 29345 16:55:34.386653 tst handover.py: using RAC 20 16:55:34.505044 tst handover.py: using CellId 29345 16:55:34.624082 tst handover.py: using BVCI 29346 16:55:34.735005 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 16:55:34.769000 tst handover.py: using LAC 29346 16:55:34.889156 tst handover.py: using RAC 21 16:55:35.007304 tst handover.py: using CellId 29346 16:55:35.127581 tst handover.py: using BVCI 29347 16:55:35.239109 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:35.249941 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:35.260408 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:35.271082 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:35.281803 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:35.292686 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 16:55:35.409414 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 16:55:35.531637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:36.006647 run create_hlr_db(pid=26908): Launched 16:55:36.132088 bus /sierra_2: Setting Powered False 16:55:37.196774 run create_hlr_db(pid=26908): Terminated: ok {rc=0} 16:55:37.603582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26910): Launched 16:55:37.906927 run osmo-hlr_10.42.42.2(pid=26911): Launched 16:55:38.022435 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:38.534606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26913): Launched 16:55:38.837980 run osmo-stp_10.42.42.5(pid=26914): Launched 16:55:38.953174 run osmo-msc_10.42.42.6: Starting osmo-msc 16:55:39.477096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26916): Launched 16:55:39.782553 run osmo-msc_10.42.42.6(pid=26917): Launched 16:55:39.953366 run osmo-stp_10.42.42.5(pid=26914): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26914)] 16:55:40.081586 run osmo-stp_10.42.42.5(pid=26914): stdout: | (launched: 2022-12-10_16:55:38.782031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:40.209935 run osmo-stp_10.42.42.5(pid=26914): stderr: | [0;m[38;5;43m20221210165538953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165538953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165538953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165538954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165538954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165538954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165538954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:40.336220 run osmo-stp_10.42.42.5(pid=26914): stdout: | (launched: 2022-12-10_16:55:38.782031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:40.457930 run osmo-stp_10.42.42.5(pid=26914): stderr: | [0;m[38;5;43m20221210165538953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165538953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165538953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165538954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165538954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165538954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165538954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:40.602743 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26914): Process ended prematurely: osmo-stp_10.42.42.5(pid=26914) [trial-2376↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26914)] [trial-2376↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 16:55:40.611127 tst handover.py:18: Test FAILED (6.4 sec) 16:55:40.637256 run osmo-hlr_10.42.42.2(pid=26911): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26911)] 16:55:40.685202 run osmo-hlr_10.42.42.2(pid=26911): stdout: | (launched: 2022-12-10_16:55:37.851202) 16:55:40.734777 run osmo-hlr_10.42.42.2(pid=26911): stderr: | [0;m[1;31m20221210165538030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165538030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165538030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165538030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165538030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165538030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165538042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165538051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165538051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165538051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:40.803930 run osmo-msc_10.42.42.6(pid=26917): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26917)] 16:55:40.852219 run osmo-msc_10.42.42.6(pid=26917): stdout: | (launched: 2022-12-10_16:55:39.725789) 16:55:40.901697 run osmo-msc_10.42.42.6(pid=26917): stderr: | [0;m[38;5;43m20221210165539998 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165539998 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f003d44ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165539998 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165539998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165539998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165539998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165540000 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165540000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165540001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165540001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:55:40.951509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26910): Terminating (SIGTERM) 16:55:40.991327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26913): Terminating (SIGTERM) 16:55:41.031239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26916): Terminating (SIGTERM) 16:55:41.071260 --- ParallelTerminationStrategy: PID 26910 died... 16:55:41.090562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26910): Terminated: ok {rc=0} 16:55:41.135215 --- ParallelTerminationStrategy: PID 26913 died... 16:55:41.154154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26913): Terminated: ok {rc=0} 16:55:41.198374 --- ParallelTerminationStrategy: PID 26916 died... 16:55:41.217190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26916): Terminated: ok {rc=0} 16:55:41.303419 bus /sierra_3: Setting Powered False 16:55:42.403996 bus /sierra_3: Setting Powered False 16:55:43.520878 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 16:55:44.765608 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:44.771316 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 16:55:44.823461 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 16:55:44.851106 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 16:55:44.906528 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 16:55:44.957408 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 16:55:44.984286 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 16:55:45.534971 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 16:55:45.540702 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:55:45.552256 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:55:45.589307 tst handover.py: using LAC 29347 16:55:45.716559 tst handover.py: using RAC 22 16:55:45.852410 tst handover.py: using CellId 29347 16:55:45.985642 tst handover.py: using BVCI 29348 16:55:46.115206 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:55:46.166532 tst handover.py: using LAC 29348 16:55:46.287917 tst handover.py: using RAC 23 16:55:46.409774 tst handover.py: using CellId 29348 16:55:46.535927 tst handover.py: using BVCI 29349 16:55:46.690179 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:55:46.704234 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:55:46.718519 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:55:46.733081 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:55:46.747075 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:55:46.760740 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:55:46.906830 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:55:47.029269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:47.506598 run create_hlr_db(pid=26922): Launched 16:55:47.632391 bus /sierra_2: Setting Powered False 16:55:48.693944 run create_hlr_db(pid=26922): Terminated: ok {rc=0} 16:55:49.111240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26924): Launched 16:55:49.438037 run osmo-hlr_10.42.42.2(pid=26925): Launched 16:55:49.562514 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:50.094562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26927): Launched 16:55:50.419753 run osmo-stp_10.42.42.5(pid=26928): Launched 16:55:50.543234 run osmo-msc_10.42.42.6: Starting osmo-msc 16:55:51.101569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26930): Launched 16:55:51.426755 run osmo-msc_10.42.42.6(pid=26931): Launched 16:55:51.607946 run osmo-stp_10.42.42.5(pid=26928): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26928)] 16:55:51.743844 run osmo-stp_10.42.42.5(pid=26928): stdout: | (launched: 2022-12-10_16:55:50.360141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:51.881272 run osmo-stp_10.42.42.5(pid=26928): stderr: | [0;m[38;5;43m20221210165550554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165550554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165550555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165550555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165550555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165550555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165550556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:52.018340 run osmo-stp_10.42.42.5(pid=26928): stdout: | (launched: 2022-12-10_16:55:50.360141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:52.147879 run osmo-stp_10.42.42.5(pid=26928): stderr: | [0;m[38;5;43m20221210165550554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165550554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165550555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165550555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165550555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165550555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165550556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:52.302352 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26928): Process ended prematurely: osmo-stp_10.42.42.5(pid=26928) [trial-2376↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26928)] [trial-2376↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 16:55:52.311366 tst handover.py:18: Test FAILED (6.8 sec) 16:55:52.339606 run osmo-hlr_10.42.42.2(pid=26925): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26925)] 16:55:52.390220 run osmo-hlr_10.42.42.2(pid=26925): stdout: | (launched: 2022-12-10_16:55:49.379224) 16:55:52.442573 run osmo-hlr_10.42.42.2(pid=26925): stderr: | [0;m[1;31m20221210165549577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165549577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165549577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165549577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165549577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165549577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165549589 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165549597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165549597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165549598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:52.515757 run osmo-msc_10.42.42.6(pid=26931): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26931)] 16:55:52.566731 run osmo-msc_10.42.42.6(pid=26931): stdout: | (launched: 2022-12-10_16:55:51.367182) 16:55:52.619379 run osmo-msc_10.42.42.6(pid=26931): stderr: | [0;m[38;5;43m20221210165551688 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165551688 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe680f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165551688 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165551688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165551689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165551689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165551690 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165551691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165551691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165551691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:55:52.672024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26924): Terminating (SIGTERM) 16:55:52.714161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26927): Terminating (SIGTERM) 16:55:52.756341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26930): Terminating (SIGTERM) 16:55:52.798795 --- ParallelTerminationStrategy: PID 26924 died... 16:55:52.818958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26924): Terminated: ok {rc=0} 16:55:52.866174 --- ParallelTerminationStrategy: PID 26927 died... 16:55:52.885842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26927): Terminated: ok {rc=0} 16:55:52.932931 --- ParallelTerminationStrategy: PID 26930 died... 16:55:52.952682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26930): Terminated: ok {rc=0} 16:55:53.041635 bus /sierra_3: Setting Powered False 16:55:54.139795 bus /sierra_3: Setting Powered False 16:55:55.255818 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:55:56.515564 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:56.521298 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:55:56.570068 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:55:56.597727 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:55:56.649320 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:55:56.696819 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:55:56.724828 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:55:57.279613 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:55:57.284929 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:55:57.296452 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:55:57.332277 tst handover.py: using LAC 29349 16:55:57.456921 tst handover.py: using RAC 24 16:55:57.585506 tst handover.py: using CellId 29349 16:55:57.710190 tst handover.py: using BVCI 29350 16:55:57.829360 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:55:57.873463 tst handover.py: using LAC 29350 16:55:58.001048 tst handover.py: using RAC 25 16:55:58.126657 tst handover.py: using CellId 29350 16:55:58.251511 tst handover.py: using BVCI 29351 16:55:58.371022 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:55:58.382595 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:55:58.393929 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:55:58.405564 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:55:58.417164 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:55:58.428598 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:55:58.547688 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:55:58.663621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:59.110395 run create_hlr_db(pid=26936): Launched 16:55:59.236538 bus /sierra_2: Setting Powered False 16:56:00.297593 run create_hlr_db(pid=26936): Terminated: ok {rc=0} 16:56:00.713556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26938): Launched 16:56:01.053572 run osmo-hlr_10.42.42.2(pid=26939): Launched 16:56:01.250960 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:02.002979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26941): Launched 16:56:02.333695 run osmo-stp_10.42.42.5(pid=26942): Launched 16:56:02.508679 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:03.069243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26944): Launched 16:56:03.395549 run osmo-msc_10.42.42.6(pid=26945): Launched 16:56:03.575996 run osmo-stp_10.42.42.5(pid=26942): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26942)] 16:56:03.713339 run osmo-stp_10.42.42.5(pid=26942): stdout: | (launched: 2022-12-10_16:56:02.270051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:03.850780 run osmo-stp_10.42.42.5(pid=26942): stderr: | [0;m[38;5;43m20221210165602486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165602486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165602486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165602487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165602487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165602487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165602487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:03.987757 run osmo-stp_10.42.42.5(pid=26942): stdout: | (launched: 2022-12-10_16:56:02.270051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:04.117574 run osmo-stp_10.42.42.5(pid=26942): stderr: | [0;m[38;5;43m20221210165602486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165602486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165602486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165602487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165602487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165602487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165602487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:04.272546 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26942): Process ended prematurely: osmo-stp_10.42.42.5(pid=26942) [trial-2376↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26942)] [trial-2376↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 16:56:04.281497 tst handover.py:18: Test FAILED (7.0 sec) 16:56:04.309794 run osmo-hlr_10.42.42.2(pid=26939): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26939)] 16:56:04.361721 run osmo-hlr_10.42.42.2(pid=26939): stdout: | (launched: 2022-12-10_16:56:00.993493) 16:56:04.414358 run osmo-hlr_10.42.42.2(pid=26939): stderr: | [0;m[1;31m20221210165601354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165601354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165601354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165601354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165601354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165601355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165601366 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165601396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165601396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165601396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:04.487673 run osmo-msc_10.42.42.6(pid=26945): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26945)] 16:56:04.538597 run osmo-msc_10.42.42.6(pid=26945): stdout: | (launched: 2022-12-10_16:56:03.335867) 16:56:04.591102 run osmo-msc_10.42.42.6(pid=26945): stderr: | [0;m[38;5;43m20221210165603656 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165603656 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4548647c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165603657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165603657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165603657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165603657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165603660 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165603660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165603660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165603660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:04.644378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26938): Terminating (SIGTERM) 16:56:04.687005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26941): Terminating (SIGTERM) 16:56:04.729579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26944): Terminating (SIGTERM) 16:56:04.772449 --- ParallelTerminationStrategy: PID 26938 died... 16:56:04.792660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26938): Terminated: ok {rc=0} 16:56:04.839988 --- ParallelTerminationStrategy: PID 26941 died... 16:56:04.859697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26941): Terminated: ok {rc=0} 16:56:04.906999 --- ParallelTerminationStrategy: PID 26944 died... 16:56:04.926734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26944): Terminated: ok {rc=0} 16:56:05.015688 bus /sierra_3: Setting Powered False 16:56:06.114266 bus /sierra_3: Setting Powered False 16:56:07.229691 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:56:08.487876 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:08.493466 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:56:08.546276 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:56:08.573611 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:56:08.627495 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:56:08.680682 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:56:08.708692 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:56:09.258505 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:56:09.264229 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:09.277424 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:56:09.312060 tst handover.py: using LAC 29351 16:56:09.431213 tst handover.py: using RAC 26 16:56:09.551979 tst handover.py: using CellId 29351 16:56:09.673003 tst handover.py: using BVCI 29352 16:56:09.783047 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:56:09.831688 tst handover.py: using LAC 29352 16:56:09.955134 tst handover.py: using RAC 27 16:56:10.074557 tst handover.py: using CellId 29352 16:56:10.193584 tst handover.py: using BVCI 29353 16:56:10.313409 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:10.324873 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:10.336103 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:10.347767 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:10.359570 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:10.370932 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:56:10.487257 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:56:10.605462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:11.081768 run create_hlr_db(pid=26951): Launched 16:56:11.205666 bus /sierra_2: Setting Powered False 16:56:12.269602 run create_hlr_db(pid=26951): Terminated: ok {rc=0} 16:56:12.692837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26953): Launched 16:56:13.017215 run osmo-hlr_10.42.42.2(pid=26954): Launched 16:56:13.142681 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:13.670605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26956): Launched 16:56:13.994281 run osmo-stp_10.42.42.5(pid=26957): Launched 16:56:14.118221 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:14.675940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26959): Launched 16:56:15.001581 run osmo-msc_10.42.42.6(pid=26960): Launched 16:56:15.182847 run osmo-stp_10.42.42.5(pid=26957): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26957)] 16:56:15.319740 run osmo-stp_10.42.42.5(pid=26957): stdout: | (launched: 2022-12-10_16:56:13.934689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:15.457714 run osmo-stp_10.42.42.5(pid=26957): stderr: | [0;m[38;5;43m20221210165614129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165614130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165614130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165614130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165614131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165614131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165614131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:15.594771 run osmo-stp_10.42.42.5(pid=26957): stdout: | (launched: 2022-12-10_16:56:13.934689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:15.724247 run osmo-stp_10.42.42.5(pid=26957): stderr: | [0;m[38;5;43m20221210165614129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165614130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165614130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165614130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165614131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165614131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165614131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:15.896024 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26957): Process ended prematurely: osmo-stp_10.42.42.5(pid=26957) [trial-2376↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26957)] [trial-2376↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 16:56:15.905625 tst handover.py:18: Test FAILED (6.6 sec) 16:56:15.933055 run osmo-hlr_10.42.42.2(pid=26954): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26954)] 16:56:15.982168 run osmo-hlr_10.42.42.2(pid=26954): stdout: | (launched: 2022-12-10_16:56:12.958084) 16:56:16.033529 run osmo-hlr_10.42.42.2(pid=26954): stderr: | [0;m[1;31m20221210165613155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165613155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165613155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165613155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165613155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165613155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165613170 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165613178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165613179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165613179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:16.106196 run osmo-msc_10.42.42.6(pid=26960): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26960)] 16:56:16.155312 run osmo-msc_10.42.42.6(pid=26960): stdout: | (launched: 2022-12-10_16:56:14.942002) 16:56:16.205899 run osmo-msc_10.42.42.6(pid=26960): stderr: | [0;m[38;5;43m20221210165615265 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165615265 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1f58f29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165615266 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165615266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165615266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165615266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165615268 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165615268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165615268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165615268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:16.257804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26953): Terminating (SIGTERM) 16:56:16.301077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26956): Terminating (SIGTERM) 16:56:16.345568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26959): Terminating (SIGTERM) 16:56:16.389708 --- ParallelTerminationStrategy: PID 26953 died... 16:56:16.409957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26953): Terminated: ok {rc=0} 16:56:16.458389 --- ParallelTerminationStrategy: PID 26956 died... 16:56:16.479091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26956): Terminated: ok {rc=0} 16:56:16.524323 --- ParallelTerminationStrategy: PID 26959 died... 16:56:16.544038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26959): Terminated: ok {rc=0} 16:56:16.634035 bus /sierra_3: Setting Powered False 16:56:17.731697 bus /sierra_3: Setting Powered False 16:56:18.846319 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 16:56:20.103334 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:20.109930 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:56:20.151172 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:56:20.179112 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:56:20.231513 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:56:20.271130 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:56:20.298800 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:56:20.849773 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 16:56:20.855385 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:20.866944 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 16:56:20.902339 tst handover.py: using LAC 29353 16:56:21.029337 tst handover.py: using RAC 28 16:56:21.156536 tst handover.py: using CellId 29353 16:56:21.283479 tst handover.py: using BVCI 29354 16:56:21.401067 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 16:56:21.436267 tst handover.py: using LAC 29354 16:56:21.563633 tst handover.py: using RAC 29 16:56:21.684747 tst handover.py: using CellId 29354 16:56:21.807113 tst handover.py: using BVCI 29355 16:56:21.918566 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:21.929541 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:21.940255 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:21.951066 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:21.961753 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:21.972324 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 16:56:22.090970 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 16:56:22.206516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:22.652202 run create_hlr_db(pid=26965): Launched 16:56:22.778406 bus /sierra_2: Setting Powered False 16:56:23.838675 run create_hlr_db(pid=26965): Terminated: ok {rc=0} 16:56:24.254550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26967): Launched 16:56:24.581560 run osmo-hlr_10.42.42.2(pid=26968): Launched 16:56:24.706251 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:25.240219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26970): Launched 16:56:25.565078 run osmo-stp_10.42.42.5(pid=26971): Launched 16:56:25.688830 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:26.248099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26973): Launched 16:56:26.572687 run osmo-msc_10.42.42.6(pid=26974): Launched 16:56:26.754201 run osmo-stp_10.42.42.5(pid=26971): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26971)] 16:56:26.891054 run osmo-stp_10.42.42.5(pid=26971): stdout: | (launched: 2022-12-10_16:56:25.505471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:27.029787 run osmo-stp_10.42.42.5(pid=26971): stderr: | [0;m[38;5;43m20221210165625700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165625700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165625700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165625700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165625701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165625701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165625701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:27.166686 run osmo-stp_10.42.42.5(pid=26971): stdout: | (launched: 2022-12-10_16:56:25.505471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:27.296388 run osmo-stp_10.42.42.5(pid=26971): stderr: | [0;m[38;5;43m20221210165625700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165625700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165625700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165625700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165625701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165625701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165625701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:27.451921 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26971): Process ended prematurely: osmo-stp_10.42.42.5(pid=26971) [trial-2376↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26971)] [trial-2376↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 16:56:27.461196 tst handover.py:18: Test FAILED (6.6 sec) 16:56:27.489832 run osmo-hlr_10.42.42.2(pid=26968): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26968)] 16:56:27.541066 run osmo-hlr_10.42.42.2(pid=26968): stdout: | (launched: 2022-12-10_16:56:24.522010) 16:56:27.593878 run osmo-hlr_10.42.42.2(pid=26968): stderr: | [0;m[1;31m20221210165624719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165624719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165624719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165624719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165624720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165624720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165624731 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165624740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165624740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165624740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:27.667497 run osmo-msc_10.42.42.6(pid=26974): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26974)] 16:56:27.718253 run osmo-msc_10.42.42.6(pid=26974): stdout: | (launched: 2022-12-10_16:56:26.513498) 16:56:27.770672 run osmo-msc_10.42.42.6(pid=26974): stderr: | [0;m[38;5;43m20221210165626835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165626835 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5aaf5ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165626835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165626835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165626836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165626836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165626837 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165626838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165626838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165626838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:27.823357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26967): Terminating (SIGTERM) 16:56:27.865931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26970): Terminating (SIGTERM) 16:56:27.908705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26973): Terminating (SIGTERM) 16:56:27.952341 --- ParallelTerminationStrategy: PID 26967 died... 16:56:27.972699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26967): Terminated: ok {rc=0} 16:56:28.020332 --- ParallelTerminationStrategy: PID 26970 died... 16:56:28.040103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26970): Terminated: ok {rc=0} 16:56:28.087746 --- ParallelTerminationStrategy: PID 26973 died... 16:56:28.107502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26973): Terminated: ok {rc=0} 16:56:28.197586 bus /sierra_3: Setting Powered False 16:56:29.297965 bus /sierra_3: Setting Powered False 16:56:30.416130 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 16:56:31.686828 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:31.696643 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:56:31.768224 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:56:31.805156 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:56:31.867097 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:56:31.932679 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:56:31.970684 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:56:32.501518 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 16:56:32.507951 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:32.519756 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:56:32.560385 tst handover.py: using LAC 29355 16:56:32.686943 tst handover.py: using RAC 30 16:56:32.811858 tst handover.py: using CellId 29355 16:56:32.942047 tst handover.py: using BVCI 29356 16:56:33.062057 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:56:33.110480 tst handover.py: using LAC 29356 16:56:33.231490 tst handover.py: using RAC 31 16:56:33.349828 tst handover.py: using CellId 29356 16:56:33.468546 tst handover.py: using BVCI 29357 16:56:33.578933 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:33.589943 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:33.600708 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:33.611590 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:33.622507 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:33.633296 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:56:33.751055 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:56:33.868552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:34.343455 run create_hlr_db(pid=26980): Launched 16:56:34.467913 bus /sierra_2: Setting Powered False 16:56:35.531458 run create_hlr_db(pid=26980): Terminated: ok {rc=0} 16:56:35.940833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26982): Launched 16:56:36.245307 run osmo-hlr_10.42.42.2(pid=26983): Launched 16:56:36.362076 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:36.859235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26985): Launched 16:56:37.163317 run osmo-stp_10.42.42.5(pid=26986): Launched 16:56:37.280562 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:37.819230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26988): Launched 16:56:38.123519 run osmo-msc_10.42.42.6(pid=26989): Launched 16:56:38.292344 run osmo-stp_10.42.42.5(pid=26986): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26986)] 16:56:38.421390 run osmo-stp_10.42.42.5(pid=26986): stdout: | (launched: 2022-12-10_16:56:37.107232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:38.549822 run osmo-stp_10.42.42.5(pid=26986): stderr: | [0;m[38;5;43m20221210165637278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165637278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165637278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165637279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165637279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165637279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165637279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:38.675916 run osmo-stp_10.42.42.5(pid=26986): stdout: | (launched: 2022-12-10_16:56:37.107232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:38.796499 run osmo-stp_10.42.42.5(pid=26986): stderr: | [0;m[38;5;43m20221210165637278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165637278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165637278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165637279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165637279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165637279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165637279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:38.942156 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26986): Process ended prematurely: osmo-stp_10.42.42.5(pid=26986) [trial-2376↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26986)] [trial-2376↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 16:56:38.950594 tst handover.py:18: Test FAILED (6.4 sec) 16:56:38.976898 run osmo-hlr_10.42.42.2(pid=26983): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26983)] 16:56:39.024849 run osmo-hlr_10.42.42.2(pid=26983): stdout: | (launched: 2022-12-10_16:56:36.189763) 16:56:39.074566 run osmo-hlr_10.42.42.2(pid=26983): stderr: | [0;m[1;31m20221210165636366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165636366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165636366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165636366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165636366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165636366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165636379 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165636388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165636388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165636388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:39.143837 run osmo-msc_10.42.42.6(pid=26989): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26989)] 16:56:39.191596 run osmo-msc_10.42.42.6(pid=26989): stdout: | (launched: 2022-12-10_16:56:38.067648) 16:56:39.240452 run osmo-msc_10.42.42.6(pid=26989): stderr: | [0;m[38;5;43m20221210165638338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165638338 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3a7932ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165638338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165638338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165638338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165638339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165638340 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165638341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165638341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165638341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:39.289698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26982): Terminating (SIGTERM) 16:56:39.329300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26985): Terminating (SIGTERM) 16:56:39.368858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26988): Terminating (SIGTERM) 16:56:39.408549 --- ParallelTerminationStrategy: PID 26982 died... 16:56:39.427722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26982): Terminated: ok {rc=0} 16:56:39.471628 --- ParallelTerminationStrategy: PID 26985 died... 16:56:39.490168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26985): Terminated: ok {rc=0} 16:56:39.534282 --- ParallelTerminationStrategy: PID 26988 died... 16:56:39.552717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26988): Terminated: ok {rc=0} 16:56:39.635955 bus /sierra_3: Setting Powered False 16:56:40.730999 bus /sierra_3: Setting Powered False 16:56:41.846015 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 16:56:43.099463 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:43.104413 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:56:43.153762 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:56:43.180208 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:56:43.230620 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:56:43.279716 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:56:43.306061 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:56:43.861456 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 16:56:43.867112 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:56:43.878699 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:56:43.917364 tst handover.py: using LAC 29357 16:56:44.043568 tst handover.py: using RAC 32 16:56:44.168649 tst handover.py: using CellId 29357 16:56:44.294214 tst handover.py: using BVCI 29358 16:56:44.413665 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:56:44.461235 tst handover.py: using LAC 29358 16:56:44.590769 tst handover.py: using RAC 33 16:56:44.709281 tst handover.py: using CellId 29358 16:56:44.826247 tst handover.py: using BVCI 29359 16:56:44.935674 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:56:44.947065 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:56:44.958016 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:56:44.968916 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:56:44.980218 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:56:44.991000 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:56:45.104933 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:56:45.220847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:45.666835 run create_hlr_db(pid=26994): Launched 16:56:45.790293 bus /sierra_2: Setting Powered False 16:56:46.878580 run create_hlr_db(pid=26994): Terminated: ok {rc=0} 16:56:47.350545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26996): Launched 16:56:47.657043 run osmo-hlr_10.42.42.2(pid=26997): Launched 16:56:47.772752 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:48.281773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26999): Launched 16:56:48.584569 run osmo-stp_10.42.42.5(pid=27000): Launched 16:56:48.699254 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:49.223045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27002): Launched 16:56:49.526620 run osmo-msc_10.42.42.6(pid=27003): Launched 16:56:49.697334 run osmo-stp_10.42.42.5(pid=27000): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27000)] 16:56:49.824600 run osmo-stp_10.42.42.5(pid=27000): stdout: | (launched: 2022-12-10_16:56:48.528401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:49.951847 run osmo-stp_10.42.42.5(pid=27000): stderr: | [0;m[38;5;43m20221210165648700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165648700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165648700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165648701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165648701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165648701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165648701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:50.078024 run osmo-stp_10.42.42.5(pid=27000): stdout: | (launched: 2022-12-10_16:56:48.528401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:50.198802 run osmo-stp_10.42.42.5(pid=27000): stderr: | [0;m[38;5;43m20221210165648700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165648700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165648700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165648701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165648701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165648701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165648701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:50.343157 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27000): Process ended prematurely: osmo-stp_10.42.42.5(pid=27000) [trial-2376↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27000)] [trial-2376↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 16:56:50.351509 tst handover.py:18: Test FAILED (6.5 sec) 16:56:50.377816 run osmo-hlr_10.42.42.2(pid=26997): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26997)] 16:56:50.425541 run osmo-hlr_10.42.42.2(pid=26997): stdout: | (launched: 2022-12-10_16:56:47.600558) 16:56:50.474808 run osmo-hlr_10.42.42.2(pid=26997): stderr: | [0;m[1;31m20221210165647776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165647776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165647776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165647776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165647776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165647776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165647789 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165647798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165647798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165647798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:50.543664 run osmo-msc_10.42.42.6(pid=27003): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27003)] 16:56:50.591633 run osmo-msc_10.42.42.6(pid=27003): stdout: | (launched: 2022-12-10_16:56:49.470783) 16:56:50.640435 run osmo-msc_10.42.42.6(pid=27003): stderr: | [0;m[38;5;43m20221210165649744 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165649744 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa910afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165649745 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165649745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165649745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165649745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165649747 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165649747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165649747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165649747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:50.689886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26996): Terminating (SIGTERM) 16:56:50.729567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26999): Terminating (SIGTERM) 16:56:50.769383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27002): Terminating (SIGTERM) 16:56:50.809436 --- ParallelTerminationStrategy: PID 26996 died... 16:56:50.828439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26996): Terminated: ok {rc=0} 16:56:50.872648 --- ParallelTerminationStrategy: PID 26999 died... 16:56:50.891222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26999): Terminated: ok {rc=0} 16:56:50.935152 --- ParallelTerminationStrategy: PID 27002 died... 16:56:50.953743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27002): Terminated: ok {rc=0} 16:56:51.040629 bus /sierra_3: Setting Powered False 16:56:52.140118 bus /sierra_3: Setting Powered False 16:56:53.255663 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 16:56:54.518389 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:54.523859 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 16:56:54.574336 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 16:56:54.602119 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 16:56:54.654903 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 16:56:54.705339 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 16:56:54.732825 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 16:56:55.282717 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 16:56:55.288157 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:55.299516 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:56:55.334336 tst handover.py: using LAC 29359 16:56:55.462334 tst handover.py: using RAC 34 16:56:55.588680 tst handover.py: using CellId 29359 16:56:55.715789 tst handover.py: using BVCI 29360 16:56:55.833295 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:56:55.882720 tst handover.py: using LAC 29360 16:56:56.010950 tst handover.py: using RAC 35 16:56:56.137367 tst handover.py: using CellId 29360 16:56:56.263818 tst handover.py: using BVCI 29361 16:56:56.383141 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:56.394518 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:56.405706 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:56.417073 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:56.428514 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:56.439850 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:56:56.560601 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:56:56.679719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:57.153658 run create_hlr_db(pid=27008): Launched 16:56:57.276616 bus /sierra_2: Setting Powered False 16:56:58.340571 run create_hlr_db(pid=27008): Terminated: ok {rc=0} 16:56:58.748696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27010): Launched 16:56:59.052582 run osmo-hlr_10.42.42.2(pid=27011): Launched 16:56:59.168764 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:59.669661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27013): Launched 16:56:59.972623 run osmo-stp_10.42.42.5(pid=27014): Launched 16:57:00.088276 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:00.615081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27016): Launched 16:57:00.941949 run osmo-msc_10.42.42.6(pid=27017): Launched 16:57:01.169958 run osmo-stp_10.42.42.5(pid=27014): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27014)] 16:57:01.328114 run osmo-stp_10.42.42.5(pid=27014): stdout: | (launched: 2022-12-10_16:56:59.917065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:01.522024 run osmo-stp_10.42.42.5(pid=27014): stderr: | [0;m[38;5;43m20221210165700088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165700088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165700088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165700088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165700089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165700089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165700089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:01.813853 run osmo-stp_10.42.42.5(pid=27014): stdout: | (launched: 2022-12-10_16:56:59.917065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:01.988908 run osmo-stp_10.42.42.5(pid=27014): stderr: | [0;m[38;5;43m20221210165700088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165700088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165700088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165700088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165700089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165700089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165700089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:02.142364 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27014): Process ended prematurely: osmo-stp_10.42.42.5(pid=27014) [trial-2376↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27014)] [trial-2376↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 16:57:02.151784 tst handover.py:18: Test FAILED (6.9 sec) 16:57:02.179322 run osmo-hlr_10.42.42.2(pid=27011): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27011)] 16:57:02.229648 run osmo-hlr_10.42.42.2(pid=27011): stdout: | (launched: 2022-12-10_16:56:58.996371) 16:57:02.280586 run osmo-hlr_10.42.42.2(pid=27011): stderr: | [0;m[1;31m20221210165659175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165659175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165659176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165659176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165659176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165659176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165659188 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165659197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165659197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165659197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:02.350683 run osmo-msc_10.42.42.6(pid=27017): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27017)] 16:57:02.399179 run osmo-msc_10.42.42.6(pid=27017): stdout: | (launched: 2022-12-10_16:57:00.880261) 16:57:02.449376 run osmo-msc_10.42.42.6(pid=27017): stderr: | [0;m[38;5;43m20221210165701516 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165701519 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9785290c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165701520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165701520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165701520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165701522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165701524 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165701524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165701524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165701524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:02.507458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27010): Terminating (SIGTERM) 16:57:02.548530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27013): Terminating (SIGTERM) 16:57:02.588712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27016): Terminating (SIGTERM) 16:57:02.629151 --- ParallelTerminationStrategy: PID 27010 died... 16:57:02.648477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27010): Terminated: ok {rc=0} 16:57:02.693226 --- ParallelTerminationStrategy: PID 27013 died... 16:57:02.712434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27013): Terminated: ok {rc=0} 16:57:02.757049 --- ParallelTerminationStrategy: PID 27016 died... 16:57:02.776018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27016): Terminated: ok {rc=0} 16:57:02.863454 bus /sierra_3: Setting Powered False 16:57:03.963588 bus /sierra_3: Setting Powered False 16:57:05.077503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:57:06.338532 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:06.344137 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:57:06.390774 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:57:06.418537 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:57:06.471166 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:57:06.517537 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:57:06.544882 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:57:07.099054 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:57:07.104607 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:07.116358 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:57:07.151492 tst handover.py: using LAC 29361 16:57:07.278975 tst handover.py: using RAC 36 16:57:07.407821 tst handover.py: using CellId 29361 16:57:07.536747 tst handover.py: using BVCI 29362 16:57:07.656655 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:57:07.702374 tst handover.py: using LAC 29362 16:57:07.831928 tst handover.py: using RAC 37 16:57:07.959959 tst handover.py: using CellId 29362 16:57:08.090509 tst handover.py: using BVCI 29363 16:57:08.210595 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:08.222380 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:08.233904 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:08.245877 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:08.257871 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:08.269958 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:57:08.387175 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:57:08.502892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:08.950856 run create_hlr_db(pid=27022): Launched 16:57:09.076203 bus /sierra_2: Setting Powered False 16:57:10.137667 run create_hlr_db(pid=27022): Terminated: ok {rc=0} 16:57:10.554574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27024): Launched 16:57:10.881405 run osmo-hlr_10.42.42.2(pid=27025): Launched 16:57:11.006748 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:11.540065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27027): Launched 16:57:11.865118 run osmo-stp_10.42.42.5(pid=27028): Launched 16:57:11.990291 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:12.551328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27030): Launched 16:57:12.877331 run osmo-msc_10.42.42.6(pid=27031): Launched 16:57:13.059160 run osmo-stp_10.42.42.5(pid=27028): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27028)] 16:57:13.195919 run osmo-stp_10.42.42.5(pid=27028): stdout: | (launched: 2022-12-10_16:57:11.805896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:13.333628 run osmo-stp_10.42.42.5(pid=27028): stderr: | [0;m[38;5;43m20221210165711997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165711997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165711997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165711998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165711998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165711998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165711998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:13.470697 run osmo-stp_10.42.42.5(pid=27028): stdout: | (launched: 2022-12-10_16:57:11.805896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:13.600339 run osmo-stp_10.42.42.5(pid=27028): stderr: | [0;m[38;5;43m20221210165711997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165711997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165711997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165711998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165711998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165711998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165711998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:13.755491 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27028): Process ended prematurely: osmo-stp_10.42.42.5(pid=27028) [trial-2376↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27028)] [trial-2376↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 16:57:13.764495 tst handover.py:18: Test FAILED (6.7 sec) 16:57:13.793077 run osmo-hlr_10.42.42.2(pid=27025): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27025)] 16:57:13.843850 run osmo-hlr_10.42.42.2(pid=27025): stdout: | (launched: 2022-12-10_16:57:10.822227) 16:57:13.896257 run osmo-hlr_10.42.42.2(pid=27025): stderr: | [0;m[1;31m20221210165711019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165711019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165711020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165711020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165711020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165711020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165711032 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165711041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165711041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165711041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:13.969483 run osmo-msc_10.42.42.6(pid=27031): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27031)] 16:57:14.020524 run osmo-msc_10.42.42.6(pid=27031): stdout: | (launched: 2022-12-10_16:57:12.817718) 16:57:14.073136 run osmo-msc_10.42.42.6(pid=27031): stderr: | [0;m[38;5;43m20221210165713144 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165713144 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0223598c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165713144 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165713144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165713144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165713144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165713146 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165713146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165713146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165713147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:14.126025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27024): Terminating (SIGTERM) 16:57:14.168747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27027): Terminating (SIGTERM) 16:57:14.211478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27030): Terminating (SIGTERM) 16:57:14.254255 --- ParallelTerminationStrategy: PID 27024 died... 16:57:14.274421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27024): Terminated: ok {rc=0} 16:57:14.321897 --- ParallelTerminationStrategy: PID 27027 died... 16:57:14.341784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27027): Terminated: ok {rc=0} 16:57:14.389207 --- ParallelTerminationStrategy: PID 27030 died... 16:57:14.408929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27030): Terminated: ok {rc=0} 16:57:14.497505 bus /sierra_3: Setting Powered False 16:57:15.598399 bus /sierra_3: Setting Powered False 16:57:16.722386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:57:17.994079 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:17.999796 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:57:18.052131 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:57:18.079883 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:57:18.135306 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:57:18.186859 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:57:18.214436 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:57:18.765670 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:57:18.771073 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:18.782536 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:57:18.821932 tst handover.py: using LAC 29363 16:57:18.946997 tst handover.py: using RAC 38 16:57:19.074305 tst handover.py: using CellId 29363 16:57:19.201430 tst handover.py: using BVCI 29364 16:57:19.319158 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:57:19.368197 tst handover.py: using LAC 29364 16:57:19.493328 tst handover.py: using RAC 39 16:57:19.618136 tst handover.py: using CellId 29364 16:57:19.745146 tst handover.py: using BVCI 29365 16:57:19.862559 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:19.874490 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:19.885877 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:19.897488 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:19.909095 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:19.920559 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:57:20.036039 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:57:20.153460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:20.627570 run create_hlr_db(pid=27036): Launched 16:57:20.750385 bus /sierra_2: Setting Powered False 16:57:21.814586 run create_hlr_db(pid=27036): Terminated: ok {rc=0} 16:57:22.238362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27038): Launched 16:57:22.564367 run osmo-hlr_10.42.42.2(pid=27039): Launched 16:57:22.688324 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:23.221689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27041): Launched 16:57:23.547065 run osmo-stp_10.42.42.5(pid=27042): Launched 16:57:23.671024 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:24.231211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27044): Launched 16:57:24.557875 run osmo-msc_10.42.42.6(pid=27045): Launched 16:57:24.740529 run osmo-stp_10.42.42.5(pid=27042): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27042)] 16:57:24.877217 run osmo-stp_10.42.42.5(pid=27042): stdout: | (launched: 2022-12-10_16:57:23.487575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:25.015552 run osmo-stp_10.42.42.5(pid=27042): stderr: | [0;m[38;5;43m20221210165723681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165723681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165723681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165723682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165723682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165723682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165723682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:25.152807 run osmo-stp_10.42.42.5(pid=27042): stdout: | (launched: 2022-12-10_16:57:23.487575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:25.282971 run osmo-stp_10.42.42.5(pid=27042): stderr: | [0;m[38;5;43m20221210165723681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165723681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165723681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165723682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165723682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165723682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165723682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:25.438254 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27042): Process ended prematurely: osmo-stp_10.42.42.5(pid=27042) [trial-2376↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27042)] [trial-2376↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 16:57:25.447128 tst handover.py:18: Test FAILED (6.7 sec) 16:57:25.475217 run osmo-hlr_10.42.42.2(pid=27039): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27039)] 16:57:25.525583 run osmo-hlr_10.42.42.2(pid=27039): stdout: | (launched: 2022-12-10_16:57:22.504691) 16:57:25.577902 run osmo-hlr_10.42.42.2(pid=27039): stderr: | [0;m[1;31m20221210165722705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165722705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165722705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165722705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165722705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165722705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165722718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165722726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165722727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165722727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:25.650587 run osmo-msc_10.42.42.6(pid=27045): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27045)] 16:57:25.700781 run osmo-msc_10.42.42.6(pid=27045): stdout: | (launched: 2022-12-10_16:57:24.498655) 16:57:25.752429 run osmo-msc_10.42.42.6(pid=27045): stderr: | [0;m[38;5;43m20221210165724819 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165724820 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f878c1efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165724820 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165724820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165724820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165724820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165724822 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165724822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165724822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165724823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:25.804695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27038): Terminating (SIGTERM) 16:57:25.846736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27041): Terminating (SIGTERM) 16:57:25.889052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27044): Terminating (SIGTERM) 16:57:25.931497 --- ParallelTerminationStrategy: PID 27038 died... 16:57:25.951532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27038): Terminated: ok {rc=0} 16:57:25.999332 --- ParallelTerminationStrategy: PID 27041 died... 16:57:26.018993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27041): Terminated: ok {rc=0} 16:57:26.065950 --- ParallelTerminationStrategy: PID 27044 died... 16:57:26.085631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27044): Terminated: ok {rc=0} 16:57:26.173475 bus /sierra_3: Setting Powered False 16:57:27.274638 bus /sierra_3: Setting Powered False 16:57:28.390584 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 16:57:29.653321 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:29.658762 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:57:29.698424 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:57:29.726153 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:57:29.779016 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:57:29.816798 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:57:29.844244 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:57:30.395025 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 16:57:30.400608 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:30.412037 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 16:57:30.446231 tst handover.py: using LAC 29365 16:57:30.574951 tst handover.py: using RAC 40 16:57:30.704645 tst handover.py: using CellId 29365 16:57:30.836332 tst handover.py: using BVCI 29366 16:57:30.983904 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 16:57:31.019200 tst handover.py: using LAC 29366 16:57:31.151055 tst handover.py: using RAC 41 16:57:31.271513 tst handover.py: using CellId 29366 16:57:31.394673 tst handover.py: using BVCI 29367 16:57:31.541747 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:31.553703 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:31.565508 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:31.578232 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:31.590781 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:31.604165 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 16:57:31.725964 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 16:57:31.848598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:32.337994 run create_hlr_db(pid=27050): Launched 16:57:32.465163 bus /sierra_2: Setting Powered False 16:57:33.529647 run create_hlr_db(pid=27050): Terminated: ok {rc=0} 16:57:33.939363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27052): Launched 16:57:34.245087 run osmo-hlr_10.42.42.2(pid=27053): Launched 16:57:34.361908 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:34.873150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27055): Launched 16:57:35.175523 run osmo-stp_10.42.42.5(pid=27056): Launched 16:57:35.290701 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:35.814282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27058): Launched 16:57:36.129352 run osmo-msc_10.42.42.6(pid=27060): Launched 16:57:36.313972 run osmo-stp_10.42.42.5(pid=27056): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27056)] 16:57:36.452654 run osmo-stp_10.42.42.5(pid=27056): stdout: | (launched: 2022-12-10_16:57:35.120201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:36.591025 run osmo-stp_10.42.42.5(pid=27056): stderr: | [0;m[38;5;43m20221210165735293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165735293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165735293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165735294 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165735294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165735294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165735294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:36.727212 run osmo-stp_10.42.42.5(pid=27056): stdout: | (launched: 2022-12-10_16:57:35.120201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:36.856453 run osmo-stp_10.42.42.5(pid=27056): stderr: | [0;m[38;5;43m20221210165735293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165735293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165735293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165735294 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165735294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165735294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165735294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:37.012012 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27056): Process ended prematurely: osmo-stp_10.42.42.5(pid=27056) [trial-2376↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27056)] [trial-2376↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 16:57:37.020930 tst handover.py:18: Test FAILED (6.6 sec) 16:57:37.049316 run osmo-hlr_10.42.42.2(pid=27053): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27053)] 16:57:37.099773 run osmo-hlr_10.42.42.2(pid=27053): stdout: | (launched: 2022-12-10_16:57:34.189403) 16:57:37.152063 run osmo-hlr_10.42.42.2(pid=27053): stderr: | [0;m[1;31m20221210165734367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165734367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165734367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165734367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165734368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165734368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165734380 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165734389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165734389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165734389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:37.225333 run osmo-msc_10.42.42.6(pid=27060): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27060)] 16:57:37.276057 run osmo-msc_10.42.42.6(pid=27060): stdout: | (launched: 2022-12-10_16:57:36.070305) 16:57:37.328410 run osmo-msc_10.42.42.6(pid=27060): stderr: | [0;m[38;5;43m20221210165736387 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165736388 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f58c90c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165736388 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165736388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165736388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165736388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165736390 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165736390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165736390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165736390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:37.381104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27052): Terminating (SIGTERM) 16:57:37.423562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27055): Terminating (SIGTERM) 16:57:37.465720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27058): Terminating (SIGTERM) 16:57:37.507950 --- ParallelTerminationStrategy: PID 27052 died... 16:57:37.528095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27052): Terminated: ok {rc=0} 16:57:37.575140 --- ParallelTerminationStrategy: PID 27055 died... 16:57:37.594703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27055): Terminated: ok {rc=0} 16:57:37.641501 --- ParallelTerminationStrategy: PID 27058 died... 16:57:37.661129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27058): Terminated: ok {rc=0} 16:57:37.748940 bus /sierra_3: Setting Powered False 16:57:38.847660 bus /sierra_3: Setting Powered False 16:57:39.963784 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 16:57:41.202735 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:41.208066 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:57:41.256716 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:57:41.283185 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:57:41.335219 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:57:41.384084 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:57:41.410969 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:57:41.959212 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 16:57:41.964312 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:41.975195 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:57:42.008173 tst handover.py: using LAC 29367 16:57:42.136729 tst handover.py: using RAC 42 16:57:42.264526 tst handover.py: using CellId 29367 16:57:42.393075 tst handover.py: using BVCI 29368 16:57:42.511545 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:57:42.561230 tst handover.py: using LAC 29368 16:57:42.688518 tst handover.py: using RAC 43 16:57:42.815463 tst handover.py: using CellId 29368 16:57:42.942696 tst handover.py: using BVCI 29369 16:57:43.062991 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:43.074918 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:43.086316 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:43.097799 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:43.109395 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:57:43.120580 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:57:43.235487 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:57:43.353231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:43.829112 run create_hlr_db(pid=27066): Launched 16:57:43.953142 bus /sierra_2: Setting Powered False 16:57:45.018317 run create_hlr_db(pid=27066): Terminated: ok {rc=0} 16:57:45.428259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27068): Launched 16:57:45.734755 run osmo-hlr_10.42.42.2(pid=27069): Launched 16:57:45.898399 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:46.514936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27071): Launched 16:57:46.853952 run osmo-stp_10.42.42.5(pid=27072): Launched 16:57:47.137817 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:47.704263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27074): Launched 16:57:48.030422 run osmo-msc_10.42.42.6(pid=27075): Launched 16:57:48.213196 run osmo-stp_10.42.42.5(pid=27072): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27072)] 16:57:48.351314 run osmo-stp_10.42.42.5(pid=27072): stdout: | (launched: 2022-12-10_16:57:46.788887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:48.489826 run osmo-stp_10.42.42.5(pid=27072): stderr: | [0;m[38;5;43m20221210165746992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165746992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165746992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165746993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165746995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165746995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165746995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:48.625749 run osmo-stp_10.42.42.5(pid=27072): stdout: | (launched: 2022-12-10_16:57:46.788887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:48.755216 run osmo-stp_10.42.42.5(pid=27072): stderr: | [0;m[38;5;43m20221210165746992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165746992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165746992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165746993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165746995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165746995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165746995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:48.910114 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27072): Process ended prematurely: osmo-stp_10.42.42.5(pid=27072) [trial-2376↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27072)] [trial-2376↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 16:57:48.919219 tst handover.py:18: Test FAILED (6.9 sec) 16:57:48.947427 run osmo-hlr_10.42.42.2(pid=27069): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27069)] 16:57:48.998850 run osmo-hlr_10.42.42.2(pid=27069): stdout: | (launched: 2022-12-10_16:57:45.678304) 16:57:49.051626 run osmo-hlr_10.42.42.2(pid=27069): stderr: | [0;m[1;31m20221210165745870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165745870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165745870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165745870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165745870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165745870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165745882 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165745894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165745895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165745895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:49.124597 run osmo-msc_10.42.42.6(pid=27075): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27075)] 16:57:49.175052 run osmo-msc_10.42.42.6(pid=27075): stdout: | (launched: 2022-12-10_16:57:47.970835) 16:57:49.227392 run osmo-msc_10.42.42.6(pid=27075): stderr: | [0;m[38;5;43m20221210165748291 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165748291 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f19c6d93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165748291 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165748291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165748291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165748292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165748293 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165748294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165748294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165748294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:49.280070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27068): Terminating (SIGTERM) 16:57:49.322451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27071): Terminating (SIGTERM) 16:57:49.364842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27074): Terminating (SIGTERM) 16:57:49.407435 --- ParallelTerminationStrategy: PID 27068 died... 16:57:49.427498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27068): Terminated: ok {rc=0} 16:57:49.474720 --- ParallelTerminationStrategy: PID 27071 died... 16:57:49.494612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27071): Terminated: ok {rc=0} 16:57:49.541570 --- ParallelTerminationStrategy: PID 27074 died... 16:57:49.561377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27074): Terminated: ok {rc=0} 16:57:49.649280 bus /sierra_3: Setting Powered False 16:57:50.747298 bus /sierra_3: Setting Powered False 16:57:51.862230 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 16:57:53.133660 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:53.138734 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:57:53.187274 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:57:53.214213 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:57:53.266416 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:57:53.315541 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:57:53.341943 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:57:53.890781 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 16:57:53.896094 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:53.907146 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:57:53.940421 tst handover.py: using LAC 29369 16:57:54.069374 tst handover.py: using RAC 44 16:57:54.194400 tst handover.py: using CellId 29369 16:57:54.312611 tst handover.py: using BVCI 29370 16:57:54.422654 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:57:54.468524 tst handover.py: using LAC 29370 16:57:54.594667 tst handover.py: using RAC 45 16:57:54.722905 tst handover.py: using CellId 29370 16:57:54.852879 tst handover.py: using BVCI 29371 16:57:54.970743 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:54.982207 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:54.993932 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:55.005414 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:55.016700 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:55.028090 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:57:55.145732 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:57:55.267547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:55.742068 run create_hlr_db(pid=27080): Launched 16:57:55.865327 bus /sierra_2: Setting Powered False 16:57:56.929206 run create_hlr_db(pid=27080): Terminated: ok {rc=0} 16:57:57.353064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27082): Launched 16:57:57.678044 run osmo-hlr_10.42.42.2(pid=27083): Launched 16:57:57.804363 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:58.338487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27085): Launched 16:57:58.662105 run osmo-stp_10.42.42.5(pid=27086): Launched 16:57:58.785609 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:59.344197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27088): Launched 16:57:59.650541 run osmo-msc_10.42.42.6(pid=27089): Launched 16:57:59.820921 run osmo-stp_10.42.42.5(pid=27086): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27086)] 16:57:59.948503 run osmo-stp_10.42.42.5(pid=27086): stdout: | (launched: 2022-12-10_16:57:58.602809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:00.077530 run osmo-stp_10.42.42.5(pid=27086): stderr: | [0;m[38;5;43m20221210165758796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165758796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165758797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165758797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165758798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165758798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165758798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:00.204196 run osmo-stp_10.42.42.5(pid=27086): stdout: | (launched: 2022-12-10_16:57:58.602809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:00.325601 run osmo-stp_10.42.42.5(pid=27086): stderr: | [0;m[38;5;43m20221210165758796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165758796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165758797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165758797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165758798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165758798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165758798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:00.470817 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27086): Process ended prematurely: osmo-stp_10.42.42.5(pid=27086) [trial-2376↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27086)] [trial-2376↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 16:58:00.479373 tst handover.py:18: Test FAILED (6.6 sec) 16:58:00.505309 run osmo-hlr_10.42.42.2(pid=27083): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27083)] 16:58:00.552660 run osmo-hlr_10.42.42.2(pid=27083): stdout: | (launched: 2022-12-10_16:57:57.618885) 16:58:00.601776 run osmo-hlr_10.42.42.2(pid=27083): stderr: | [0;m[1;31m20221210165757817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165757817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165757817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165757817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165757817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165757817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165757830 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165757838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165757838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165757839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:00.670302 run osmo-msc_10.42.42.6(pid=27089): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27089)] 16:58:00.717625 run osmo-msc_10.42.42.6(pid=27089): stdout: | (launched: 2022-12-10_16:57:59.594813) 16:58:00.766389 run osmo-msc_10.42.42.6(pid=27089): stderr: | [0;m[38;5;43m20221210165759867 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165759867 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e7f75fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165759867 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165759867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165759867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165759867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165759869 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165759870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165759870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165759870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:00.815355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27082): Terminating (SIGTERM) 16:58:00.873939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27085): Terminating (SIGTERM) 16:58:00.919304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27088): Terminating (SIGTERM) 16:58:00.964140 --- ParallelTerminationStrategy: PID 27082 died... 16:58:00.985026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27082): Terminated: ok {rc=0} 16:58:01.037567 --- ParallelTerminationStrategy: PID 27085 died... 16:58:01.058441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27085): Terminated: ok {rc=0} 16:58:01.109638 --- ParallelTerminationStrategy: PID 27088 died... 16:58:01.130344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27088): Terminated: ok {rc=0} 16:58:01.229213 bus /sierra_3: Setting Powered False 16:58:02.343362 bus /sierra_3: Setting Powered False 16:58:03.459675 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:58:04.717452 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:04.723521 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:58:04.784478 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:58:04.812011 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:58:04.867165 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:58:04.928818 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:58:04.956419 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:58:05.506866 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:58:05.512577 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:05.524292 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:58:05.574003 tst handover.py: using LAC 29371 16:58:05.708314 tst handover.py: using RAC 46 16:58:05.831568 tst handover.py: using CellId 29371 16:58:05.956291 tst handover.py: using BVCI 29372 16:58:06.067672 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:58:06.111612 tst handover.py: using LAC 29372 16:58:06.230356 tst handover.py: using RAC 47 16:58:06.347623 tst handover.py: using CellId 29372 16:58:06.476233 tst handover.py: using BVCI 29373 16:58:06.596214 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:06.608143 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:06.619614 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:06.633010 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:06.644489 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:06.656637 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:58:06.774055 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:58:06.889107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:07.333848 run create_hlr_db(pid=27094): Launched 16:58:07.458803 bus /sierra_2: Setting Powered False 16:58:08.519240 run create_hlr_db(pid=27094): Terminated: ok {rc=0} 16:58:08.918104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27096): Launched 16:58:09.225349 run osmo-hlr_10.42.42.2(pid=27097): Launched 16:58:09.342913 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:09.854848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27099): Launched 16:58:10.159094 run osmo-stp_10.42.42.5(pid=27100): Launched 16:58:10.275257 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:10.797360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27102): Launched 16:58:11.100814 run osmo-msc_10.42.42.6(pid=27103): Launched 16:58:11.270178 run osmo-stp_10.42.42.5(pid=27100): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27100)] 16:58:11.398305 run osmo-stp_10.42.42.5(pid=27100): stdout: | (launched: 2022-12-10_16:58:10.103221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:11.526282 run osmo-stp_10.42.42.5(pid=27100): stderr: | [0;m[38;5;43m20221210165810273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165810274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165810274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165810274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165810276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165810277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165810277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:11.653579 run osmo-stp_10.42.42.5(pid=27100): stdout: | (launched: 2022-12-10_16:58:10.103221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:11.774606 run osmo-stp_10.42.42.5(pid=27100): stderr: | [0;m[38;5;43m20221210165810273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165810274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165810274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165810274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165810276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165810277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165810277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:11.919403 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27100): Process ended prematurely: osmo-stp_10.42.42.5(pid=27100) [trial-2376↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27100)] [trial-2376↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 16:58:11.927654 tst handover.py:18: Test FAILED (6.4 sec) 16:58:11.953498 run osmo-hlr_10.42.42.2(pid=27097): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27097)] 16:58:12.000558 run osmo-hlr_10.42.42.2(pid=27097): stdout: | (launched: 2022-12-10_16:58:09.168810) 16:58:12.049674 run osmo-hlr_10.42.42.2(pid=27097): stderr: | [0;m[1;31m20221210165809346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165809346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165809346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165809346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165809346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165809346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165809356 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165809365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165809365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165809365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:12.118263 run osmo-msc_10.42.42.6(pid=27103): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27103)] 16:58:12.165448 run osmo-msc_10.42.42.6(pid=27103): stdout: | (launched: 2022-12-10_16:58:11.044895) 16:58:12.214481 run osmo-msc_10.42.42.6(pid=27103): stderr: | [0;m[38;5;43m20221210165811315 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165811315 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff7a7785c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165811315 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165811315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165811316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165811316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165811318 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165811318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165811318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165811318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:12.263671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27096): Terminating (SIGTERM) 16:58:12.303088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27099): Terminating (SIGTERM) 16:58:12.342483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27102): Terminating (SIGTERM) 16:58:12.382206 --- ParallelTerminationStrategy: PID 27096 died... 16:58:12.401101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27096): Terminated: ok {rc=0} 16:58:12.444873 --- ParallelTerminationStrategy: PID 27099 died... 16:58:12.463725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27099): Terminated: ok {rc=0} 16:58:12.507874 --- ParallelTerminationStrategy: PID 27102 died... 16:58:12.526517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27102): Terminated: ok {rc=0} 16:58:12.611744 bus /sierra_3: Setting Powered False 16:58:13.711334 bus /sierra_3: Setting Powered False 16:58:14.823816 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:58:16.103173 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:16.112629 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:58:16.183968 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:58:16.214641 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:58:16.270042 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:58:16.349582 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:58:16.379474 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:58:16.939477 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:58:16.944561 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:16.960684 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:58:17.018277 tst handover.py: using LAC 29373 16:58:17.150374 tst handover.py: using RAC 48 16:58:17.291700 tst handover.py: using CellId 29373 16:58:17.409436 tst handover.py: using BVCI 29374 16:58:17.521903 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:58:17.569623 tst handover.py: using LAC 29374 16:58:17.697892 tst handover.py: using RAC 49 16:58:17.823858 tst handover.py: using CellId 29374 16:58:17.949820 tst handover.py: using BVCI 29375 16:58:18.069273 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:18.080919 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:18.092578 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:18.104670 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:18.116663 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:18.128845 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:58:18.244432 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:58:18.365544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:18.841761 run create_hlr_db(pid=27108): Launched 16:58:18.967423 bus /sierra_2: Setting Powered False 16:58:20.031536 run create_hlr_db(pid=27108): Terminated: ok {rc=0} 16:58:20.441689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27110): Launched 16:58:20.747192 run osmo-hlr_10.42.42.2(pid=27111): Launched 16:58:20.863154 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:21.363158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27113): Launched 16:58:21.666768 run osmo-stp_10.42.42.5(pid=27114): Launched 16:58:21.783695 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:22.309586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27116): Launched 16:58:22.614773 run osmo-msc_10.42.42.6(pid=27117): Launched 16:58:22.784814 run osmo-stp_10.42.42.5(pid=27114): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27114)] 16:58:22.913415 run osmo-stp_10.42.42.5(pid=27114): stdout: | (launched: 2022-12-10_16:58:21.610455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:23.042451 run osmo-stp_10.42.42.5(pid=27114): stderr: | [0;m[38;5;43m20221210165821781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165821782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165821782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165821782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165821783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165821783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165821783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:23.169318 run osmo-stp_10.42.42.5(pid=27114): stdout: | (launched: 2022-12-10_16:58:21.610455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:23.290649 run osmo-stp_10.42.42.5(pid=27114): stderr: | [0;m[38;5;43m20221210165821781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165821782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165821782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165821782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165821783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165821783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165821783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:23.436697 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27114): Process ended prematurely: osmo-stp_10.42.42.5(pid=27114) [trial-2376↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27114)] [trial-2376↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 16:58:23.445034 tst handover.py:18: Test FAILED (6.5 sec) 16:58:23.471092 run osmo-hlr_10.42.42.2(pid=27111): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27111)] 16:58:23.518877 run osmo-hlr_10.42.42.2(pid=27111): stdout: | (launched: 2022-12-10_16:58:20.690550) 16:58:23.568250 run osmo-hlr_10.42.42.2(pid=27111): stderr: | [0;m[1;31m20221210165820868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165820868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165820868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165820868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165820868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165820869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165820881 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165820890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165820890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165820890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:23.637186 run osmo-msc_10.42.42.6(pid=27117): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27117)] 16:58:23.684902 run osmo-msc_10.42.42.6(pid=27117): stdout: | (launched: 2022-12-10_16:58:22.558931) 16:58:23.734531 run osmo-msc_10.42.42.6(pid=27117): stderr: | [0;m[38;5;43m20221210165822828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165822828 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f86f07afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165822828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165822828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165822828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165822828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165822830 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165822831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165822831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165822831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:23.784436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27110): Terminating (SIGTERM) 16:58:23.824484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27113): Terminating (SIGTERM) 16:58:23.864355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27116): Terminating (SIGTERM) 16:58:23.904488 --- ParallelTerminationStrategy: PID 27110 died... 16:58:23.923942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27110): Terminated: ok {rc=0} 16:58:23.968068 --- ParallelTerminationStrategy: PID 27113 died... 16:58:23.986758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27113): Terminated: ok {rc=0} 16:58:24.030893 --- ParallelTerminationStrategy: PID 27116 died... 16:58:24.049495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27116): Terminated: ok {rc=0} 16:58:24.135385 bus /sierra_3: Setting Powered False 16:58:25.237449 bus /sierra_3: Setting Powered False 16:58:26.354016 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 16:58:27.629178 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:27.634838 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:58:27.687519 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:58:27.715313 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:58:27.773220 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:58:27.824771 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:58:27.851126 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:58:28.394866 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 16:58:28.399930 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:28.410828 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 16:58:28.458368 tst handover.py: using LAC 29375 16:58:28.577365 tst handover.py: using RAC 50 16:58:28.697362 tst handover.py: using CellId 29375 16:58:28.814657 tst handover.py: using BVCI 29376 16:58:28.924168 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 16:58:28.957933 tst handover.py: using LAC 29376 16:58:29.084599 tst handover.py: using RAC 51 16:58:29.210294 tst handover.py: using CellId 29376 16:58:29.335957 tst handover.py: using BVCI 29377 16:58:29.453776 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:29.464940 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:29.476511 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:29.487870 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:29.499293 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:29.510572 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 16:58:29.626992 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 16:58:29.744560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:30.219929 run create_hlr_db(pid=27123): Launched 16:58:30.343353 bus /sierra_2: Setting Powered False 16:58:31.412180 run create_hlr_db(pid=27123): Terminated: ok {rc=0} 16:58:31.833768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27125): Launched 16:58:32.155569 run osmo-hlr_10.42.42.2(pid=27126): Launched 16:58:32.281607 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:32.815674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27128): Launched 16:58:33.141983 run osmo-stp_10.42.42.5(pid=27129): Launched 16:58:33.267016 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:33.826565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27131): Launched 16:58:34.153792 run osmo-msc_10.42.42.6(pid=27132): Launched 16:58:34.336700 run osmo-stp_10.42.42.5(pid=27129): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27129)] 16:58:34.474967 run osmo-stp_10.42.42.5(pid=27129): stdout: | (launched: 2022-12-10_16:58:33.082972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:34.615042 run osmo-stp_10.42.42.5(pid=27129): stderr: | [0;m[38;5;43m20221210165833275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165833276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165833276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165833276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165833277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165833277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165833277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:34.753416 run osmo-stp_10.42.42.5(pid=27129): stdout: | (launched: 2022-12-10_16:58:33.082972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:34.883391 run osmo-stp_10.42.42.5(pid=27129): stderr: | [0;m[38;5;43m20221210165833275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165833276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165833276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165833276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165833277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165833277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165833277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:35.039037 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27129): Process ended prematurely: osmo-stp_10.42.42.5(pid=27129) [trial-2376↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27129)] [trial-2376↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 16:58:35.047933 tst handover.py:18: Test FAILED (6.6 sec) 16:58:35.076251 run osmo-hlr_10.42.42.2(pid=27126): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27126)] 16:58:35.126915 run osmo-hlr_10.42.42.2(pid=27126): stdout: | (launched: 2022-12-10_16:58:32.098334) 16:58:35.179340 run osmo-hlr_10.42.42.2(pid=27126): stderr: | [0;m[1;31m20221210165832302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165832302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165832302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165832302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165832302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165832302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165832315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165832325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165832325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165832326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:35.252473 run osmo-msc_10.42.42.6(pid=27132): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27132)] 16:58:35.302925 run osmo-msc_10.42.42.6(pid=27132): stdout: | (launched: 2022-12-10_16:58:34.094460) 16:58:35.354941 run osmo-msc_10.42.42.6(pid=27132): stderr: | [0;m[38;5;43m20221210165834430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165834430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f321e060c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165834430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165834430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165834430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165834430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165834432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165834432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165834449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165834449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:35.407467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27125): Terminating (SIGTERM) 16:58:35.449468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27128): Terminating (SIGTERM) 16:58:35.492083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27131): Terminating (SIGTERM) 16:58:35.534476 --- ParallelTerminationStrategy: PID 27125 died... 16:58:35.554461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27125): Terminated: ok {rc=0} 16:58:35.601413 --- ParallelTerminationStrategy: PID 27128 died... 16:58:35.620859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27128): Terminated: ok {rc=0} 16:58:35.667471 --- ParallelTerminationStrategy: PID 27131 died... 16:58:35.686878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27131): Terminated: ok {rc=0} 16:58:35.775139 bus /sierra_3: Setting Powered False 16:58:36.873336 bus /sierra_3: Setting Powered False 16:58:37.989302 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 16:58:39.241099 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:39.246073 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:58:39.307889 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:58:39.334303 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:58:39.386950 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:58:39.449481 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:58:39.475823 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:58:40.024658 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 16:58:40.029778 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:40.040594 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:58:40.092763 tst handover.py: using LAC 29377 16:58:40.218662 tst handover.py: using RAC 52 16:58:40.345421 tst handover.py: using CellId 29377 16:58:40.465832 tst handover.py: using BVCI 29378 16:58:40.576824 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:58:40.628867 tst handover.py: using LAC 29378 16:58:40.746829 tst handover.py: using RAC 53 16:58:40.866000 tst handover.py: using CellId 29378 16:58:40.983527 tst handover.py: using BVCI 29379 16:58:41.093431 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:41.104235 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:41.114949 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:41.125671 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:41.136267 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:41.146964 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:58:41.266145 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:58:41.384582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:41.859842 run create_hlr_db(pid=27137): Launched 16:58:41.985129 bus /sierra_2: Setting Powered False 16:58:43.049673 run create_hlr_db(pid=27137): Terminated: ok {rc=0} 16:58:43.473229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27139): Launched 16:58:43.797706 run osmo-hlr_10.42.42.2(pid=27140): Launched 16:58:43.923493 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:44.453299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27142): Launched 16:58:44.777868 run osmo-stp_10.42.42.5(pid=27143): Launched 16:58:44.903872 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:45.467838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27145): Launched 16:58:45.794564 run osmo-msc_10.42.42.6(pid=27146): Launched 16:58:46.116374 run osmo-stp_10.42.42.5(pid=27143): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27143)] 16:58:46.266682 run osmo-stp_10.42.42.5(pid=27143): stdout: | (launched: 2022-12-10_16:58:44.718583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:46.417572 run osmo-stp_10.42.42.5(pid=27143): stderr: | [0;m[38;5;43m20221210165844913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165844913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165844913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165844913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165844914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165844914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165844914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:46.563337 run osmo-stp_10.42.42.5(pid=27143): stdout: | (launched: 2022-12-10_16:58:44.718583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:46.690607 run osmo-stp_10.42.42.5(pid=27143): stderr: | [0;m[38;5;43m20221210165844913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165844913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165844913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165844913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165844914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165844914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165844914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:46.839598 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27143): Process ended prematurely: osmo-stp_10.42.42.5(pid=27143) [trial-2376↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27143)] [trial-2376↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 16:58:46.848343 tst handover.py:18: Test FAILED (6.8 sec) 16:58:46.876781 run osmo-hlr_10.42.42.2(pid=27140): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27140)] 16:58:46.926673 run osmo-hlr_10.42.42.2(pid=27140): stdout: | (launched: 2022-12-10_16:58:43.738512) 16:58:46.978082 run osmo-hlr_10.42.42.2(pid=27140): stderr: | [0;m[1;31m20221210165843938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165843938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165843938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165843938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165843938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165843938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165843951 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165843959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165843959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165843959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:47.050582 run osmo-msc_10.42.42.6(pid=27146): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27146)] 16:58:47.100801 run osmo-msc_10.42.42.6(pid=27146): stdout: | (launched: 2022-12-10_16:58:45.734959) 16:58:47.151882 run osmo-msc_10.42.42.6(pid=27146): stderr: | [0;m[38;5;43m20221210165846194 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165846194 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f144f4aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165846194 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165846194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165846194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165846195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165846196 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165846197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165846197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165846197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:47.203680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27139): Terminating (SIGTERM) 16:58:47.246880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27142): Terminating (SIGTERM) 16:58:47.291405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27145): Terminating (SIGTERM) 16:58:47.335289 --- ParallelTerminationStrategy: PID 27139 died... 16:58:47.355868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27139): Terminated: ok {rc=0} 16:58:47.402910 --- ParallelTerminationStrategy: PID 27142 died... 16:58:47.422352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27142): Terminated: ok {rc=0} 16:58:47.468097 --- ParallelTerminationStrategy: PID 27145 died... 16:58:47.488303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27145): Terminated: ok {rc=0} 16:58:47.574541 bus /sierra_3: Setting Powered False 16:58:48.675163 bus /sierra_3: Setting Powered False 16:58:49.794580 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 16:58:51.064381 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:51.069581 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:58:51.130855 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:58:51.157351 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:58:51.210548 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:58:51.276111 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:58:51.303389 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:58:51.846973 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 16:58:51.852162 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:51.863155 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:58:51.910593 tst handover.py: using LAC 29379 16:58:52.032472 tst handover.py: using RAC 54 16:58:52.161807 tst handover.py: using CellId 29379 16:58:52.289367 tst handover.py: using BVCI 29380 16:58:52.407280 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:58:52.456843 tst handover.py: using LAC 29380 16:58:52.584799 tst handover.py: using RAC 55 16:58:52.711667 tst handover.py: using CellId 29380 16:58:52.838756 tst handover.py: using BVCI 29381 16:58:52.958000 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:52.969333 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:52.980296 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:52.991749 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:53.003163 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:53.014652 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:58:53.131176 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:58:53.248187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:53.723889 run create_hlr_db(pid=27151): Launched 16:58:53.847468 bus /sierra_2: Setting Powered False 16:58:54.911604 run create_hlr_db(pid=27151): Terminated: ok {rc=0} 16:58:55.323559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27153): Launched 16:58:55.628936 run osmo-hlr_10.42.42.2(pid=27154): Launched 16:58:55.744447 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:56.260588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27156): Launched 16:58:56.565529 run osmo-stp_10.42.42.5(pid=27157): Launched 16:58:56.681931 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:57.207807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27159): Launched 16:58:57.512815 run osmo-msc_10.42.42.6(pid=27160): Launched 16:58:57.683233 run osmo-stp_10.42.42.5(pid=27157): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27157)] 16:58:57.811277 run osmo-stp_10.42.42.5(pid=27157): stdout: | (launched: 2022-12-10_16:58:56.508786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:57.939362 run osmo-stp_10.42.42.5(pid=27157): stderr: | [0;m[38;5;43m20221210165856680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165856680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165856680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165856681 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165856683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165856683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165856683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:58.066533 run osmo-stp_10.42.42.5(pid=27157): stdout: | (launched: 2022-12-10_16:58:56.508786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:58.187657 run osmo-stp_10.42.42.5(pid=27157): stderr: | [0;m[38;5;43m20221210165856680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165856680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165856680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165856681 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165856683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165856683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165856683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:58.332056 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27157): Process ended prematurely: osmo-stp_10.42.42.5(pid=27157) [trial-2376↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27157)] [trial-2376↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 16:58:58.340572 tst handover.py:18: Test FAILED (6.5 sec) 16:58:58.366909 run osmo-hlr_10.42.42.2(pid=27154): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27154)] 16:58:58.414945 run osmo-hlr_10.42.42.2(pid=27154): stdout: | (launched: 2022-12-10_16:58:55.572916) 16:58:58.464589 run osmo-hlr_10.42.42.2(pid=27154): stderr: | [0;m[1;31m20221210165855751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165855751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165855751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165855751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165855751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165855751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165855763 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165855772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165855773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165855773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:58.534206 run osmo-msc_10.42.42.6(pid=27160): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27160)] 16:58:58.582192 run osmo-msc_10.42.42.6(pid=27160): stdout: | (launched: 2022-12-10_16:58:57.456598) 16:58:58.631874 run osmo-msc_10.42.42.6(pid=27160): stderr: | [0;m[38;5;43m20221210165857730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165857731 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f032062cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165857731 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165857731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165857731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165857731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165857733 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165857733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165857733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165857733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:58.682051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27153): Terminating (SIGTERM) 16:58:58.721894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27156): Terminating (SIGTERM) 16:58:58.761972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27159): Terminating (SIGTERM) 16:58:58.802250 --- ParallelTerminationStrategy: PID 27153 died... 16:58:58.821383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27153): Terminated: ok {rc=0} 16:58:58.866165 --- ParallelTerminationStrategy: PID 27156 died... 16:58:58.884909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27156): Terminated: ok {rc=0} 16:58:58.929151 --- ParallelTerminationStrategy: PID 27159 died... 16:58:58.947866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27159): Terminated: ok {rc=0} 16:58:59.033985 bus /sierra_3: Setting Powered False 16:59:00.134498 bus /sierra_3: Setting Powered False 16:59:01.276067 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:59:02.555286 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:02.561346 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:59:02.622990 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:59:02.650805 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:59:02.708414 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:59:02.769712 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:59:02.797289 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:59:03.347779 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:59:03.353315 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:03.364903 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:59:03.410500 tst handover.py: using LAC 29381 16:59:03.536305 tst handover.py: using RAC 56 16:59:03.654725 tst handover.py: using CellId 29381 16:59:03.775226 tst handover.py: using BVCI 29382 16:59:03.885656 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:59:03.934244 tst handover.py: using LAC 29382 16:59:04.053370 tst handover.py: using RAC 57 16:59:04.170733 tst handover.py: using CellId 29382 16:59:04.288472 tst handover.py: using BVCI 29383 16:59:04.407858 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:04.419786 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:04.431318 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:04.443100 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:04.455055 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:04.466759 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:59:04.586163 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:59:04.704093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:05.180493 run create_hlr_db(pid=27165): Launched 16:59:05.306102 bus /sierra_2: Setting Powered False 16:59:06.370637 run create_hlr_db(pid=27165): Terminated: ok {rc=0} 16:59:06.780334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27167): Launched 16:59:07.085912 run osmo-hlr_10.42.42.2(pid=27168): Launched 16:59:07.201825 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:07.700578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27170): Launched 16:59:08.005151 run osmo-stp_10.42.42.5(pid=27171): Launched 16:59:08.122152 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:08.649059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27173): Launched 16:59:08.953916 run osmo-msc_10.42.42.6(pid=27174): Launched 16:59:09.124398 run osmo-stp_10.42.42.5(pid=27171): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27171)] 16:59:09.253266 run osmo-stp_10.42.42.5(pid=27171): stdout: | (launched: 2022-12-10_16:59:07.949168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:09.381662 run osmo-stp_10.42.42.5(pid=27171): stderr: | [0;m[38;5;43m20221210165908123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165908123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165908123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165908124 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165908124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165908124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165908124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:09.508479 run osmo-stp_10.42.42.5(pid=27171): stdout: | (launched: 2022-12-10_16:59:07.949168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:09.629831 run osmo-stp_10.42.42.5(pid=27171): stderr: | [0;m[38;5;43m20221210165908123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165908123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165908123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165908124 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165908124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165908124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165908124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:09.774841 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27171): Process ended prematurely: osmo-stp_10.42.42.5(pid=27171) [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27171)] [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 16:59:09.783001 tst handover.py:18: Test FAILED (6.4 sec) 16:59:09.809240 run osmo-hlr_10.42.42.2(pid=27168): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27168)] 16:59:09.856938 run osmo-hlr_10.42.42.2(pid=27168): stdout: | (launched: 2022-12-10_16:59:07.029480) 16:59:09.906238 run osmo-hlr_10.42.42.2(pid=27168): stderr: | [0;m[1;31m20221210165907205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165907205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165907205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165907205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165907205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165907205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165907217 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165907227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165907227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165907227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:09.975122 run osmo-msc_10.42.42.6(pid=27174): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27174)] 16:59:10.022791 run osmo-msc_10.42.42.6(pid=27174): stdout: | (launched: 2022-12-10_16:59:08.898074) 16:59:10.071767 run osmo-msc_10.42.42.6(pid=27174): stderr: | [0;m[38;5;43m20221210165909171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165909172 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb11d268c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165909172 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165909172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165909172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165909172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165909175 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165909175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165909175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165909176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:10.121823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27167): Terminating (SIGTERM) 16:59:10.161458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27170): Terminating (SIGTERM) 16:59:10.201040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27173): Terminating (SIGTERM) 16:59:10.241056 --- ParallelTerminationStrategy: PID 27167 died... 16:59:10.260482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27167): Terminated: ok {rc=0} 16:59:10.305114 --- ParallelTerminationStrategy: PID 27170 died... 16:59:10.323773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27170): Terminated: ok {rc=0} 16:59:10.367504 --- ParallelTerminationStrategy: PID 27173 died... 16:59:10.386104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27173): Terminated: ok {rc=0} 16:59:10.471993 bus /sierra_3: Setting Powered False 16:59:11.573755 bus /sierra_3: Setting Powered False 16:59:12.689286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 16:59:13.957609 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:13.962843 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:59:14.009141 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:59:14.035650 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:59:14.086480 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:59:14.133389 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:59:14.160026 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:59:14.712060 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 16:59:14.717131 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:14.728144 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 16:59:14.771324 tst handover.py: using LAC 29383 16:59:14.891708 tst handover.py: using RAC 58 16:59:15.012333 tst handover.py: using CellId 29383 16:59:15.131548 tst handover.py: using BVCI 29384 16:59:15.241677 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 16:59:15.276817 tst handover.py: using LAC 29384 16:59:15.411058 tst handover.py: using RAC 59 16:59:15.538123 tst handover.py: using CellId 29384 16:59:15.666319 tst handover.py: using BVCI 29385 16:59:15.785970 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:15.797689 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:15.809170 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:15.820877 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:15.846631 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:15.859737 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 16:59:15.981673 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 16:59:16.097775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:16.559073 run create_hlr_db(pid=27179): Launched 16:59:16.743584 bus /sierra_2: Setting Powered False 16:59:17.807109 run create_hlr_db(pid=27179): Terminated: ok {rc=0} 16:59:18.216930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27181): Launched 16:59:18.521618 run osmo-hlr_10.42.42.2(pid=27182): Launched 16:59:18.639586 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:19.154320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27184): Launched 16:59:19.458936 run osmo-stp_10.42.42.5(pid=27185): Launched 16:59:19.574745 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:20.098376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27187): Launched 16:59:20.403234 run osmo-msc_10.42.42.6(pid=27188): Launched 16:59:20.573085 run osmo-stp_10.42.42.5(pid=27185): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27185)] 16:59:20.701633 run osmo-stp_10.42.42.5(pid=27185): stdout: | (launched: 2022-12-10_16:59:19.402811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:20.829691 run osmo-stp_10.42.42.5(pid=27185): stderr: | [0;m[38;5;43m20221210165919576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165919576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165919577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165919577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165919578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165919578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165919578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:20.956111 run osmo-stp_10.42.42.5(pid=27185): stdout: | (launched: 2022-12-10_16:59:19.402811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:21.076873 run osmo-stp_10.42.42.5(pid=27185): stderr: | [0;m[38;5;43m20221210165919576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165919576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165919577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165919577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165919578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165919578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165919578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:21.221386 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27185): Process ended prematurely: osmo-stp_10.42.42.5(pid=27185) [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27185)] [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 16:59:21.229547 tst handover.py:18: Test FAILED (6.5 sec) 16:59:21.255719 run osmo-hlr_10.42.42.2(pid=27182): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27182)] 16:59:21.303290 run osmo-hlr_10.42.42.2(pid=27182): stdout: | (launched: 2022-12-10_16:59:18.465377) 16:59:21.352839 run osmo-hlr_10.42.42.2(pid=27182): stderr: | [0;m[1;31m20221210165918645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165918645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165918645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165918645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165918645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165918645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165918657 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165918666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165918666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165918666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:21.421692 run osmo-msc_10.42.42.6(pid=27188): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27188)] 16:59:21.468929 run osmo-msc_10.42.42.6(pid=27188): stdout: | (launched: 2022-12-10_16:59:20.347281) 16:59:21.517890 run osmo-msc_10.42.42.6(pid=27188): stderr: | [0;m[38;5;43m20221210165920619 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165920619 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2aa1c8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165920619 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165920619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165920619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165920620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165920621 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165920622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165920622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165920622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:21.567164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27181): Terminating (SIGTERM) 16:59:21.606652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27184): Terminating (SIGTERM) 16:59:21.646185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27187): Terminating (SIGTERM) 16:59:21.685990 --- ParallelTerminationStrategy: PID 27181 died... 16:59:21.704899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27181): Terminated: ok {rc=0} 16:59:21.749117 --- ParallelTerminationStrategy: PID 27184 died... 16:59:21.767707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27184): Terminated: ok {rc=0} 16:59:21.811689 --- ParallelTerminationStrategy: PID 27187 died... 16:59:21.830392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27187): Terminated: ok {rc=0} 16:59:21.915957 bus /sierra_3: Setting Powered False 16:59:23.014557 bus /sierra_3: Setting Powered False 16:59:24.130686 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 16:59:25.386009 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:25.391662 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:59:25.452310 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:59:25.480399 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:59:25.535143 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:59:25.596253 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:59:25.623903 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:59:26.171045 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 16:59:26.176170 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:26.187262 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:59:26.230489 tst handover.py: using LAC 29385 16:59:26.353133 tst handover.py: using RAC 60 16:59:26.471165 tst handover.py: using CellId 29385 16:59:26.589424 tst handover.py: using BVCI 29386 16:59:26.701515 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:59:26.748575 tst handover.py: using LAC 29386 16:59:26.866569 tst handover.py: using RAC 61 16:59:26.985600 tst handover.py: using CellId 29386 16:59:27.102866 tst handover.py: using BVCI 29387 16:59:27.213096 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:27.224106 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:27.235094 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:27.246179 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:27.257046 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:27.267839 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:59:27.385392 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:59:27.501479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:27.946631 run create_hlr_db(pid=27193): Launched 16:59:28.072849 bus /sierra_2: Setting Powered False 16:59:29.133865 run create_hlr_db(pid=27193): Terminated: ok {rc=0} 16:59:29.552568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27195): Launched 16:59:29.877900 run osmo-hlr_10.42.42.2(pid=27196): Launched 16:59:30.003136 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:30.537038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27198): Launched 16:59:30.865698 run osmo-stp_10.42.42.5(pid=27199): Launched 16:59:31.113470 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:31.795979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27201): Launched 16:59:32.129678 run osmo-msc_10.42.42.6(pid=27202): Launched 16:59:32.354857 run osmo-stp_10.42.42.5(pid=27199): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27199)] 16:59:32.483709 run osmo-stp_10.42.42.5(pid=27199): stdout: | (launched: 2022-12-10_16:59:30.801433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:32.611843 run osmo-stp_10.42.42.5(pid=27199): stderr: | [0;m[38;5;43m20221210165931135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165931135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165931135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165931136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165931136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165931136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165931136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:32.738686 run osmo-stp_10.42.42.5(pid=27199): stdout: | (launched: 2022-12-10_16:59:30.801433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:32.860025 run osmo-stp_10.42.42.5(pid=27199): stderr: | [0;m[38;5;43m20221210165931135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165931135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165931135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165931136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165931136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165931136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165931136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:33.004577 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27199): Process ended prematurely: osmo-stp_10.42.42.5(pid=27199) [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27199)] [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 16:59:33.013051 tst handover.py:18: Test FAILED (6.8 sec) 16:59:33.039539 run osmo-hlr_10.42.42.2(pid=27196): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27196)] 16:59:33.087772 run osmo-hlr_10.42.42.2(pid=27196): stdout: | (launched: 2022-12-10_16:59:29.818774) 16:59:33.137338 run osmo-hlr_10.42.42.2(pid=27196): stderr: | [0;m[1;31m20221210165930016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165930016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165930016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165930016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165930016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165930016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165930028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165930037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165930037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165930037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:33.206803 run osmo-msc_10.42.42.6(pid=27202): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27202)] 16:59:33.254561 run osmo-msc_10.42.42.6(pid=27202): stdout: | (launched: 2022-12-10_16:59:32.066259) 16:59:33.303893 run osmo-msc_10.42.42.6(pid=27202): stderr: | [0;m[38;5;43m20221210165932371 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165932371 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f92393a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165932371 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165932371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165932371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165932371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165932373 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165932373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165932374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165932374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:33.353830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27195): Terminating (SIGTERM) 16:59:33.393553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27198): Terminating (SIGTERM) 16:59:33.433373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27201): Terminating (SIGTERM) 16:59:33.473918 --- ParallelTerminationStrategy: PID 27195 died... 16:59:33.492706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27195): Terminated: ok {rc=0} 16:59:33.537058 --- ParallelTerminationStrategy: PID 27198 died... 16:59:33.555674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27198): Terminated: ok {rc=0} 16:59:33.601232 --- ParallelTerminationStrategy: PID 27201 died... 16:59:33.619946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27201): Terminated: ok {rc=0} 16:59:33.704242 bus /sierra_3: Setting Powered False 16:59:34.802589 bus /sierra_3: Setting Powered False 16:59:35.922561 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 16:59:37.192396 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:37.197467 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:59:37.255246 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:59:37.281724 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:59:37.332632 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:59:37.392670 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:59:37.420425 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:59:37.970589 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 16:59:37.975719 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:37.986875 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:59:38.030655 tst handover.py: using LAC 29387 16:59:38.149938 tst handover.py: using RAC 62 16:59:38.267611 tst handover.py: using CellId 29387 16:59:38.396280 tst handover.py: using BVCI 29388 16:59:38.508925 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:59:38.561835 tst handover.py: using LAC 29388 16:59:38.681388 tst handover.py: using RAC 63 16:59:38.799177 tst handover.py: using CellId 29388 16:59:38.918332 tst handover.py: using BVCI 29389 16:59:39.030471 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:39.041623 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:39.052510 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:39.063449 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:39.074377 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:39.085335 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:59:39.202713 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:59:39.321774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:39.798890 run create_hlr_db(pid=27207): Launched 16:59:39.923742 bus /sierra_2: Setting Powered False 16:59:40.987807 run create_hlr_db(pid=27207): Terminated: ok {rc=0} 16:59:41.413991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27209): Launched 16:59:41.739753 run osmo-hlr_10.42.42.2(pid=27210): Launched 16:59:41.864491 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:42.399270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27212): Launched 16:59:42.726179 run osmo-stp_10.42.42.5(pid=27213): Launched 16:59:42.850658 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:43.409570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27215): Launched 16:59:43.735206 run osmo-msc_10.42.42.6(pid=27216): Launched 16:59:43.917620 run osmo-stp_10.42.42.5(pid=27213): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27213)] 16:59:44.054703 run osmo-stp_10.42.42.5(pid=27213): stdout: | (launched: 2022-12-10_16:59:42.666855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:44.192158 run osmo-stp_10.42.42.5(pid=27213): stderr: | [0;m[38;5;43m20221210165942858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165942859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165942859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165942859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165942860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165942860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165942860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:44.328464 run osmo-stp_10.42.42.5(pid=27213): stdout: | (launched: 2022-12-10_16:59:42.666855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:44.458086 run osmo-stp_10.42.42.5(pid=27213): stderr: | [0;m[38;5;43m20221210165942858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165942859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165942859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165942859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165942860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165942860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165942860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:44.612624 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27213): Process ended prematurely: osmo-stp_10.42.42.5(pid=27213) [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27213)] [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 16:59:44.621727 tst handover.py:18: Test FAILED (6.6 sec) 16:59:44.649766 run osmo-hlr_10.42.42.2(pid=27210): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27210)] 16:59:44.700030 run osmo-hlr_10.42.42.2(pid=27210): stdout: | (launched: 2022-12-10_16:59:41.680181) 16:59:44.752166 run osmo-hlr_10.42.42.2(pid=27210): stderr: | [0;m[1;31m20221210165941878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165941878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165941878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165941878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165941878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165941878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165941892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165941902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165941902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165941902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:44.824482 run osmo-msc_10.42.42.6(pid=27216): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27216)] 16:59:44.874662 run osmo-msc_10.42.42.6(pid=27216): stdout: | (launched: 2022-12-10_16:59:43.675751) 16:59:44.926415 run osmo-msc_10.42.42.6(pid=27216): stderr: | [0;m[38;5;43m20221210165943995 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165943995 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f622e565c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165943995 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165943995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165943996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165943996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165943997 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165943998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165943998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165943998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:44.978535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27209): Terminating (SIGTERM) 16:59:45.020299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27212): Terminating (SIGTERM) 16:59:45.062701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27215): Terminating (SIGTERM) 16:59:45.105234 --- ParallelTerminationStrategy: PID 27209 died... 16:59:45.125362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27209): Terminated: ok {rc=0} 16:59:45.172311 --- ParallelTerminationStrategy: PID 27212 died... 16:59:45.192027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27212): Terminated: ok {rc=0} 16:59:45.239403 --- ParallelTerminationStrategy: PID 27215 died... 16:59:45.259432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27215): Terminated: ok {rc=0} 16:59:45.347860 bus /sierra_3: Setting Powered False 16:59:46.448488 bus /sierra_3: Setting Powered False 16:59:47.572445 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 16:59:48.843368 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:48.849132 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:59:48.902525 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:59:48.930253 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:59:48.984269 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:59:49.035390 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:59:49.062251 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:59:49.611675 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 16:59:49.616752 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:49.627849 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 16:59:49.675451 tst handover.py: using LAC 29389 16:59:49.799618 tst handover.py: using RAC 64 16:59:49.918399 tst handover.py: using CellId 29389 16:59:50.036272 tst handover.py: using BVCI 29390 16:59:50.146351 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 16:59:50.179958 tst handover.py: using LAC 29390 16:59:50.297716 tst handover.py: using RAC 65 16:59:50.414883 tst handover.py: using CellId 29390 16:59:50.532680 tst handover.py: using BVCI 29391 16:59:50.642179 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:50.653210 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:50.663917 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:50.674700 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:50.685507 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:50.696252 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 16:59:50.808384 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 16:59:50.925862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:51.401984 run create_hlr_db(pid=27221): Launched 16:59:51.527849 bus /sierra_2: Setting Powered False 16:59:52.591516 run create_hlr_db(pid=27221): Terminated: ok {rc=0} 16:59:53.000829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27223): Launched 16:59:53.305900 run osmo-hlr_10.42.42.2(pid=27224): Launched 16:59:53.422230 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:53.920793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27226): Launched 16:59:54.225450 run osmo-stp_10.42.42.5(pid=27227): Launched 16:59:54.343207 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:54.869992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27229): Launched 16:59:55.200213 run osmo-msc_10.42.42.6(pid=27230): Launched 16:59:55.381536 run osmo-stp_10.42.42.5(pid=27227): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27227)] 16:59:55.518701 run osmo-stp_10.42.42.5(pid=27227): stdout: | (launched: 2022-12-10_16:59:54.169576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:55.657486 run osmo-stp_10.42.42.5(pid=27227): stderr: | [0;m[38;5;43m20221210165954341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165954341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165954341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165954342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165954344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165954344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165954344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:55.794734 run osmo-stp_10.42.42.5(pid=27227): stdout: | (launched: 2022-12-10_16:59:54.169576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:55.924616 run osmo-stp_10.42.42.5(pid=27227): stderr: | [0;m[38;5;43m20221210165954341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210165954341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210165954341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210165954342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210165954344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210165954344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210165954344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:56.080088 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27227): Process ended prematurely: osmo-stp_10.42.42.5(pid=27227) [trial-2376↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27227)] [trial-2376↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 16:59:56.089065 tst handover.py:18: Test FAILED (6.5 sec) 16:59:56.117131 run osmo-hlr_10.42.42.2(pid=27224): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27224)] 16:59:56.167515 run osmo-hlr_10.42.42.2(pid=27224): stdout: | (launched: 2022-12-10_16:59:53.249258) 16:59:56.219703 run osmo-hlr_10.42.42.2(pid=27224): stderr: | [0;m[1;31m20221210165953425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210165953425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210165953425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210165953426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210165953426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210165953426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210165953441 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210165953451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210165953451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210165953451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:56.292233 run osmo-msc_10.42.42.6(pid=27230): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27230)] 16:59:56.342344 run osmo-msc_10.42.42.6(pid=27230): stdout: | (launched: 2022-12-10_16:59:55.141082) 16:59:56.394129 run osmo-msc_10.42.42.6(pid=27230): stderr: | [0;m[38;5;43m20221210165955462 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210165955462 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa770499c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210165955462 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210165955462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210165955462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210165955462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210165955466 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210165955466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210165955466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210165955466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:56.446438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27223): Terminating (SIGTERM) 16:59:56.489020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27226): Terminating (SIGTERM) 16:59:56.531435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27229): Terminating (SIGTERM) 16:59:56.573791 --- ParallelTerminationStrategy: PID 27223 died... 16:59:56.593964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27223): Terminated: ok {rc=0} 16:59:56.640396 --- ParallelTerminationStrategy: PID 27226 died... 16:59:56.659913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27226): Terminated: ok {rc=0} 16:59:56.706340 --- ParallelTerminationStrategy: PID 27229 died... 16:59:56.725819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27229): Terminated: ok {rc=0} 16:59:56.813630 bus /sierra_3: Setting Powered False 16:59:57.913054 bus /sierra_3: Setting Powered False 16:59:59.030546 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 17:00:00.294393 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:00.299978 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:00:00.365430 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:00:00.392724 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:00:00.446486 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:00:00.515544 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:00:00.543324 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:00:01.093665 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 17:00:01.100528 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:01.112910 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:00:01.165605 tst handover.py: using LAC 29391 17:00:01.311194 tst handover.py: using RAC 66 17:00:01.449202 tst handover.py: using CellId 29391 17:00:01.574512 tst handover.py: using BVCI 29392 17:00:01.714103 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:00:01.763092 tst handover.py: using LAC 29392 17:00:01.917514 tst handover.py: using RAC 67 17:00:02.059048 tst handover.py: using CellId 29392 17:00:02.190231 tst handover.py: using BVCI 29393 17:00:02.313874 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:02.325895 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:02.337768 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:02.349953 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:02.362190 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:02.373598 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:00:02.488938 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:00:02.610593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:03.086165 run create_hlr_db(pid=27238): Launched 17:00:03.211943 bus /sierra_2: Setting Powered False 17:00:04.276805 run create_hlr_db(pid=27238): Terminated: ok {rc=0} 17:00:04.701765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27240): Launched 17:00:05.027950 run osmo-hlr_10.42.42.2(pid=27241): Launched 17:00:05.152929 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:05.683608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27243): Launched 17:00:06.009688 run osmo-stp_10.42.42.5(pid=27244): Launched 17:00:06.135747 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:06.697049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27246): Launched 17:00:07.021947 run osmo-msc_10.42.42.6(pid=27247): Launched 17:00:07.207508 run osmo-stp_10.42.42.5(pid=27244): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27244)] 17:00:07.344406 run osmo-stp_10.42.42.5(pid=27244): stdout: | (launched: 2022-12-10_17:00:05.950374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:07.482843 run osmo-stp_10.42.42.5(pid=27244): stderr: | [0;m[38;5;43m20221210170006145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210170006145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210170006145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210170006146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210170006146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210170006146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210170006146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:07.619613 run osmo-stp_10.42.42.5(pid=27244): stdout: | (launched: 2022-12-10_17:00:05.950374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:07.748597 run osmo-stp_10.42.42.5(pid=27244): stderr: | [0;m[38;5;43m20221210170006145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210170006145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210170006145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210170006146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210170006146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210170006146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210170006146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:07.903661 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27244): Process ended prematurely: osmo-stp_10.42.42.5(pid=27244) [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27244)] [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 17:00:07.912477 tst handover.py:18: Test FAILED (6.8 sec) 17:00:07.940408 run osmo-hlr_10.42.42.2(pid=27241): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27241)] 17:00:07.990919 run osmo-hlr_10.42.42.2(pid=27241): stdout: | (launched: 2022-12-10_17:00:04.968471) 17:00:08.042838 run osmo-hlr_10.42.42.2(pid=27241): stderr: | [0;m[1;31m20221210170005169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210170005169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210170005169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210170005169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210170005169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210170005169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210170005181 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210170005190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210170005190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210170005190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:08.116272 run osmo-msc_10.42.42.6(pid=27247): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27247)] 17:00:08.166544 run osmo-msc_10.42.42.6(pid=27247): stdout: | (launched: 2022-12-10_17:00:06.962460) 17:00:08.218255 run osmo-msc_10.42.42.6(pid=27247): stderr: | [0;m[38;5;43m20221210170007284 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210170007284 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f586f7c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210170007285 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210170007285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210170007285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210170007285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210170007287 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210170007287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210170007287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210170007287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:08.270448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27240): Terminating (SIGTERM) 17:00:08.312447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27243): Terminating (SIGTERM) 17:00:08.354722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27246): Terminating (SIGTERM) 17:00:08.397051 --- ParallelTerminationStrategy: PID 27240 died... 17:00:08.417142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27240): Terminated: ok {rc=0} 17:00:08.463815 --- ParallelTerminationStrategy: PID 27243 died... 17:00:08.483397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27243): Terminated: ok {rc=0} 17:00:08.529824 --- ParallelTerminationStrategy: PID 27246 died... 17:00:08.549381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27246): Terminated: ok {rc=0} 17:00:08.638204 bus /sierra_3: Setting Powered False 17:00:09.733944 bus /sierra_3: Setting Powered False 17:00:10.848869 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 17:00:12.121078 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:12.126532 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:00:12.189769 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:00:12.216723 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:00:12.268208 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:00:12.330956 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:00:12.357422 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:00:12.910831 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 17:00:12.915921 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:12.927106 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:12.976606 tst handover.py: using LAC 29393 17:00:13.098303 tst handover.py: using RAC 68 17:00:13.220341 tst handover.py: using CellId 29393 17:00:13.341767 tst handover.py: using BVCI 29394 17:00:13.452567 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:13.501303 tst handover.py: using LAC 29394 17:00:13.622890 tst handover.py: using RAC 69 17:00:13.742391 tst handover.py: using CellId 29394 17:00:13.863601 tst handover.py: using BVCI 29395 17:00:13.976093 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:13.987154 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:13.998130 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:14.009811 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:14.021297 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:14.032579 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:14.146434 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:14.260547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:14.706006 run create_hlr_db(pid=27252): Launched 17:00:14.832032 bus /sierra_2: Setting Powered False 17:00:15.906149 run create_hlr_db(pid=27252): Terminated: ok {rc=0} 17:00:16.351962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27254): Launched 17:00:16.721639 run osmo-hlr_10.42.42.2(pid=27255): Launched 17:00:16.899541 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:17.602449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27257): Launched 17:00:17.907818 run osmo-stp_10.42.42.5(pid=27258): Launched 17:00:18.022864 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:18.546665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27260): Launched 17:00:18.853785 run osmo-msc_10.42.42.6(pid=27261): Launched 17:00:19.024319 run osmo-stp_10.42.42.5(pid=27258): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27258)] 17:00:19.153322 run osmo-stp_10.42.42.5(pid=27258): stdout: | (launched: 2022-12-10_17:00:17.851864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:19.281908 run osmo-stp_10.42.42.5(pid=27258): stderr: | [0;m[38;5;43m20221210170018023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210170018023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210170018023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210170018024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210170018024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210170018024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210170018024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:19.408206 run osmo-stp_10.42.42.5(pid=27258): stdout: | (launched: 2022-12-10_17:00:17.851864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:19.529553 run osmo-stp_10.42.42.5(pid=27258): stderr: | [0;m[38;5;43m20221210170018023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210170018023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210170018023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210170018024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210170018024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210170018024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210170018024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:19.674466 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27258): Process ended prematurely: osmo-stp_10.42.42.5(pid=27258) [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27258)] [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 17:00:19.682781 tst handover.py:18: Test FAILED (6.8 sec) 17:00:19.708766 run osmo-hlr_10.42.42.2(pid=27255): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27255)] 17:00:19.756432 run osmo-hlr_10.42.42.2(pid=27255): stdout: | (launched: 2022-12-10_17:00:16.660612) 17:00:19.805671 run osmo-hlr_10.42.42.2(pid=27255): stderr: | [0;m[1;31m20221210170016999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210170016999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210170016999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210170016999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210170016999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210170016999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210170017019 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210170017027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210170017027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210170017027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:19.874678 run osmo-msc_10.42.42.6(pid=27261): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27261)] 17:00:19.922189 run osmo-msc_10.42.42.6(pid=27261): stdout: | (launched: 2022-12-10_17:00:18.797837) 17:00:19.971220 run osmo-msc_10.42.42.6(pid=27261): stderr: | [0;m[38;5;43m20221210170019070 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210170019070 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8b6adf9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210170019070 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210170019070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210170019070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210170019070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210170019072 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210170019073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210170019074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210170019074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:20.020670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27254): Terminating (SIGTERM) 17:00:20.060342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27257): Terminating (SIGTERM) 17:00:20.099924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27260): Terminating (SIGTERM) 17:00:20.140180 --- ParallelTerminationStrategy: PID 27254 died... 17:00:20.159427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27254): Terminated: ok {rc=0} 17:00:20.203991 --- ParallelTerminationStrategy: PID 27257 died... 17:00:20.222718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27257): Terminated: ok {rc=0} 17:00:20.266715 --- ParallelTerminationStrategy: PID 27260 died... 17:00:20.285501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27260): Terminated: ok {rc=0} 17:00:20.370472 bus /sierra_3: Setting Powered False 17:00:21.470379 bus /sierra_3: Setting Powered False 17:00:22.586896 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 17:00:23.858740 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:23.863791 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:00:23.914065 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:00:23.940700 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:00:23.993827 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:00:24.044321 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:00:24.070922 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:00:24.623139 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 17:00:24.628206 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:24.639111 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:00:24.672297 tst handover.py: using LAC 29395 17:00:24.793179 tst handover.py: using RAC 70 17:00:24.913444 tst handover.py: using CellId 29395 17:00:25.036219 tst handover.py: using BVCI 29396 17:00:25.147149 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:00:25.193685 tst handover.py: using LAC 29396 17:00:25.313531 tst handover.py: using RAC 71 17:00:25.433540 tst handover.py: using CellId 29396 17:00:25.561649 tst handover.py: using BVCI 29397 17:00:25.680829 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:25.692408 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:25.703745 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:25.715372 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:25.727019 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:25.738399 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:00:25.855207 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:00:25.969337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:26.418326 run create_hlr_db(pid=27266): Launched 17:00:26.542765 bus /sierra_2: Setting Powered False 17:00:27.608031 run create_hlr_db(pid=27266): Terminated: ok {rc=0} 17:00:28.033922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27268): Launched 17:00:28.360937 run osmo-hlr_10.42.42.2(pid=27269): Launched 17:00:28.485584 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:29.017594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27271): Launched 17:00:29.343888 run osmo-stp_10.42.42.5(pid=27272): Launched 17:00:29.468129 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:30.027863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27274): Launched 17:00:30.353084 run osmo-msc_10.42.42.6(pid=27275): Launched 17:00:30.536069 run osmo-stp_10.42.42.5(pid=27272): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27272)] 17:00:30.673739 run osmo-stp_10.42.42.5(pid=27272): stdout: | (launched: 2022-12-10_17:00:29.284132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:30.811170 run osmo-stp_10.42.42.5(pid=27272): stderr: | [0;m[38;5;43m20221210170029478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210170029478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210170029478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210170029479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210170029479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210170029479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210170029479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:30.990939 run osmo-stp_10.42.42.5(pid=27272): stdout: | (launched: 2022-12-10_17:00:29.284132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:31.155587 run osmo-stp_10.42.42.5(pid=27272): stderr: | [0;m[38;5;43m20221210170029478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210170029478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210170029478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210170029479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210170029479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210170029479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210170029479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:31.307281 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27272): Process ended prematurely: osmo-stp_10.42.42.5(pid=27272) [trial-2376↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27272)] [trial-2376↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 17:00:31.316285 tst handover.py:18: Test FAILED (6.7 sec) 17:00:31.344349 run osmo-hlr_10.42.42.2(pid=27269): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27269)] 17:00:31.393652 run osmo-hlr_10.42.42.2(pid=27269): stdout: | (launched: 2022-12-10_17:00:28.301122) 17:00:31.445172 run osmo-hlr_10.42.42.2(pid=27269): stderr: | [0;m[1;31m20221210170028500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210170028500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210170028500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210170028500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210170028500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210170028500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210170028512 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210170028520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210170028520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210170028520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:31.516504 run osmo-msc_10.42.42.6(pid=27275): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27275)] 17:00:31.565619 run osmo-msc_10.42.42.6(pid=27275): stdout: | (launched: 2022-12-10_17:00:30.293648) 17:00:31.616046 run osmo-msc_10.42.42.6(pid=27275): stderr: | [0;m[38;5;43m20221210170030617 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210170030617 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3935128c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210170030617 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210170030617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210170030618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210170030618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210170030619 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210170030620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210170030620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210170030620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:31.667358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27268): Terminating (SIGTERM) 17:00:31.709927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27271): Terminating (SIGTERM) 17:00:31.753276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27274): Terminating (SIGTERM) 17:00:31.796598 --- ParallelTerminationStrategy: PID 27268 died... 17:00:31.816361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27268): Terminated: ok {rc=0} 17:00:31.863437 --- ParallelTerminationStrategy: PID 27271 died... 17:00:31.884189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27271): Terminated: ok {rc=0} 17:00:31.930197 --- ParallelTerminationStrategy: PID 27274 died... 17:00:31.949682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27274): Terminated: ok {rc=0} 17:00:32.035385 bus /sierra_3: Setting Powered False 17:00:33.132832 bus /sierra_3: Setting Powered False 17:00:34.247807 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 17:00:35.507696 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:35.513342 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:00:35.565118 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:00:35.592655 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:00:35.647321 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:00:35.698875 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:00:35.726540 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:00:36.275040 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 17:00:36.280364 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:36.291808 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:36.327053 tst handover.py: using LAC 29397 17:00:36.455082 tst handover.py: using RAC 72 17:00:36.583512 tst handover.py: using CellId 29397 17:00:36.711789 tst handover.py: using BVCI 29398 17:00:36.831778 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:36.879830 tst handover.py: using LAC 29398 17:00:37.007913 tst handover.py: using RAC 73 17:00:37.135443 tst handover.py: using CellId 29398 17:00:37.262469 tst handover.py: using BVCI 29399 17:00:37.381941 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:37.393258 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:37.404241 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:37.415718 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:37.427246 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:37.438641 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:37.557347 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:37.675131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:38.153128 run create_hlr_db(pid=27280): Launched 17:00:38.277083 bus /sierra_2: Setting Powered False 17:00:39.341807 run create_hlr_db(pid=27280): Terminated: ok {rc=0} 17:00:39.766870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27282): Launched 17:00:40.092455 run osmo-hlr_10.42.42.2(pid=27283): Launched 17:00:40.218843 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:40.752472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27285): Launched 17:00:41.078162 run osmo-stp_10.42.42.5(pid=27286): Launched 17:00:41.204735 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:41.766712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27288): Launched 17:00:42.094075 run osmo-msc_10.42.42.6(pid=27289): Launched 17:00:42.278231 run osmo-stp_10.42.42.5(pid=27286): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27286)] 17:00:42.416274 run osmo-stp_10.42.42.5(pid=27286): stdout: | (launched: 2022-12-10_17:00:41.018370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:42.554995 run osmo-stp_10.42.42.5(pid=27286): stderr: | [0;m[38;5;43m20221210170041210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210170041210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210170041211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210170041211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210170041211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210170041212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210170041212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:42.692273 run osmo-stp_10.42.42.5(pid=27286): stdout: | (launched: 2022-12-10_17:00:41.018370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:42.822562 run osmo-stp_10.42.42.5(pid=27286): stderr: | [0;m[38;5;43m20221210170041210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210170041210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210170041211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210170041211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210170041211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210170041212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210170041212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:42.977794 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27286): Process ended prematurely: osmo-stp_10.42.42.5(pid=27286) [trial-2376↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27286)] [trial-2376↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 17:00:42.986805 tst handover.py:18: Test FAILED (6.7 sec) 17:00:43.015169 run osmo-hlr_10.42.42.2(pid=27283): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27283)] 17:00:43.066424 run osmo-hlr_10.42.42.2(pid=27283): stdout: | (launched: 2022-12-10_17:00:40.032883) 17:00:43.119371 run osmo-hlr_10.42.42.2(pid=27283): stderr: | [0;m[1;31m20221210170040231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210170040231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210170040231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210170040231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210170040231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210170040231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210170040244 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210170040252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210170040252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210170040252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:43.192708 run osmo-msc_10.42.42.6(pid=27289): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27289)] 17:00:43.243306 run osmo-msc_10.42.42.6(pid=27289): stdout: | (launched: 2022-12-10_17:00:42.034117) 17:00:43.295513 run osmo-msc_10.42.42.6(pid=27289): stderr: | [0;m[38;5;43m20221210170042357 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210170042357 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff5e3a67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210170042357 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210170042357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210170042357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210170042358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210170042359 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210170042360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210170042360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210170042360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:43.348308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27282): Terminating (SIGTERM) 17:00:43.390882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27285): Terminating (SIGTERM) 17:00:43.433381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27288): Terminating (SIGTERM) 17:00:43.476051 --- ParallelTerminationStrategy: PID 27282 died... 17:00:43.496306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27282): Terminated: ok {rc=0} 17:00:43.543618 --- ParallelTerminationStrategy: PID 27285 died... 17:00:43.563465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27285): Terminated: ok {rc=0} 17:00:43.610473 --- ParallelTerminationStrategy: PID 27288 died... 17:00:43.630270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27288): Terminated: ok {rc=0} 17:00:43.720032 bus /sierra_3: Setting Powered False 17:00:44.818525 bus /sierra_3: Setting Powered False 17:00:45.938158 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2376 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 17:00:47.229745 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:47.235781 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:00:47.300188 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:00:47.328608 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:00:47.382716 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:00:47.447661 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:00:47.475027 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:00:48.019162 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2376 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 17:00:48.025394 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:48.036809 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:48.089090 tst handover.py: using LAC 29399 17:00:48.207774 tst handover.py: using RAC 74 17:00:48.325366 tst handover.py: using CellId 29399 17:00:48.442747 tst handover.py: using BVCI 29400 17:00:48.552707 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:48.599352 tst handover.py: using LAC 29400 17:00:48.716665 tst handover.py: using RAC 75 17:00:48.834894 tst handover.py: using CellId 29400 17:00:48.953028 tst handover.py: using BVCI 29401 17:00:49.062932 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:49.073899 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:49.084596 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:49.095615 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:49.106628 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:49.117540 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:49.233977 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:49.353125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:49.798827 run create_hlr_db(pid=27294): Launched 17:00:49.922758 bus /sierra_2: Setting Powered False 17:00:50.983323 run create_hlr_db(pid=27294): Terminated: ok {rc=0} 17:00:51.399312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27296): Launched 17:00:51.725913 run osmo-hlr_10.42.42.2(pid=27297): Launched 17:00:51.850138 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:52.382775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27299): Launched 17:00:52.708257 run osmo-stp_10.42.42.5(pid=27300): Launched 17:00:52.832580 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:53.394379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27302): Launched 17:00:53.721190 run osmo-msc_10.42.42.6(pid=27303): Launched 17:00:53.902369 run osmo-stp_10.42.42.5(pid=27300): ERR: Terminated: ERROR {rc=1} [trial-2376↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27300)] 17:00:54.039344 run osmo-stp_10.42.42.5(pid=27300): stdout: | (launched: 2022-12-10_17:00:52.648462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:54.177910 run osmo-stp_10.42.42.5(pid=27300): stderr: | [0;m[38;5;43m20221210170052840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210170052840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210170052840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210170052841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210170052841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210170052841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210170052841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:54.314584 run osmo-stp_10.42.42.5(pid=27300): stdout: | (launched: 2022-12-10_17:00:52.648462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:54.444178 run osmo-stp_10.42.42.5(pid=27300): stderr: | [0;m[38;5;43m20221210170052840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210170052840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210170052840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210170052841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210170052841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210170052841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210170052841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:54.599049 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27300): Process ended prematurely: osmo-stp_10.42.42.5(pid=27300) [trial-2376↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27300)] [trial-2376↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 17:00:54.607735 tst handover.py:18: Test FAILED (6.6 sec) 17:00:54.635803 run osmo-hlr_10.42.42.2(pid=27297): ERR: Terminated: ERROR {rc=237} [trial-2376↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27297)] 17:00:54.686433 run osmo-hlr_10.42.42.2(pid=27297): stdout: | (launched: 2022-12-10_17:00:51.666636) 17:00:54.738269 run osmo-hlr_10.42.42.2(pid=27297): stderr: | [0;m[1;31m20221210170051864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210170051864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210170051864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210170051864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210170051864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210170051864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210170051877 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210170051885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210170051886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210170051886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:54.810830 run osmo-msc_10.42.42.6(pid=27303): ERR: Terminated: ERROR {rc=2} [trial-2376↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27303)] 17:00:54.861240 run osmo-msc_10.42.42.6(pid=27303): stdout: | (launched: 2022-12-10_17:00:53.661361) 17:00:54.913103 run osmo-msc_10.42.42.6(pid=27303): stderr: | [0;m[38;5;43m20221210170053983 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210170053984 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f714a3e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210170053984 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210170053984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210170053984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210170053984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210170053986 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210170053986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210170053986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210170053986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:54.966013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27296): Terminating (SIGTERM) 17:00:55.008266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27299): Terminating (SIGTERM) 17:00:55.050571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27302): Terminating (SIGTERM) 17:00:55.093383 --- ParallelTerminationStrategy: PID 27296 died... 17:00:55.113604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27296): Terminated: ok {rc=0} 17:00:55.160788 --- ParallelTerminationStrategy: PID 27299 died... 17:00:55.180463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27299): Terminated: ok {rc=0} 17:00:55.227184 --- ParallelTerminationStrategy: PID 27302 died... 17:00:55.246750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27302): Terminated: ok {rc=0} 17:00:55.335607 bus /sierra_3: Setting Powered False 17:00:56.434932 bus /sierra_3: Setting Powered False 17:00:57.552689 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2376 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 17:00:58.824659 tst trial-2376: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376/run.2022-12-10_15-37-08/trial-2376.xml -------------------------------------------------------------------------------------------- trial-2376 FAIL -------------------------------------------------------------------------------------------- 17:01:00.766449 tst trial-2376: trial-2376: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=19657): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19657) [trial-2376↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19657)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.4 sec) Error: osmo-stp_10.42.42.5(pid=19669): Process ended prematurely: osmo-stp_10.42.42.5(pid=19669) [trial-2376↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19669)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=19678): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19678) [trial-2376↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19678)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19688): Process ended prematurely: osmo-stp_10.42.42.5(pid=19688) [trial-2376↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19688)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19706): Process ended prematurely: osmo-stp_10.42.42.5(pid=19706) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19706)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19717): Process ended prematurely: osmo-stp_10.42.42.5(pid=19717) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19717)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19732): Process ended prematurely: osmo-stp_10.42.42.5(pid=19732) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19732)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19749): Process ended prematurely: osmo-stp_10.42.42.5(pid=19749) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19749)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19763): Process ended prematurely: osmo-stp_10.42.42.5(pid=19763) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19763)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19776): Process ended prematurely: osmo-stp_10.42.42.5(pid=19776) [trial-2376↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19776)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19790): Process ended prematurely: osmo-stp_10.42.42.5(pid=19790) [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19790)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19801): Process ended prematurely: osmo-stp_10.42.42.5(pid=19801) [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19801)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19816): Process ended prematurely: osmo-stp_10.42.42.5(pid=19816) [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19816)] FAIL: mo_mt_call_osmux.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=19827): Process ended prematurely: osmo-stp_10.42.42.5(pid=19827) [trial-2376↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19827)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19841): Process ended prematurely: osmo-stp_10.42.42.5(pid=19841) [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19841)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19859): Process ended prematurely: osmo-stp_10.42.42.5(pid=19859) [trial-2376↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19859)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19873): Process ended prematurely: osmo-stp_10.42.42.5(pid=19873) [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19873)] FAIL: mo_mt_call_osmux.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=19884): Process ended prematurely: osmo-stp_10.42.42.5(pid=19884) [trial-2376↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19884)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19898): Process ended prematurely: osmo-stp_10.42.42.5(pid=19898) [trial-2376↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19898)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19909): Process ended prematurely: osmo-stp_10.42.42.5(pid=19909) [trial-2376↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19909)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=19927): Process ended prematurely: osmo-stp_10.42.42.5(pid=19927) [trial-2376↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19927)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19939): Process ended prematurely: osmo-stp_10.42.42.5(pid=19939) [trial-2376↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19939)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=19957): Process ended prematurely: osmo-stp_10.42.42.5(pid=19957) [trial-2376↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19957)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19968): Process ended prematurely: osmo-stp_10.42.42.5(pid=19968) [trial-2376↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19968)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19978): Process ended prematurely: osmo-stp_10.42.42.5(pid=19978) [trial-2376↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19978)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19997): Process ended prematurely: osmo-stp_10.42.42.5(pid=19997) [trial-2376↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19997)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20009): Process ended prematurely: osmo-stp_10.42.42.5(pid=20009) [trial-2376↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20009)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=20027): Process ended prematurely: osmo-stp_10.42.42.5(pid=20027) [trial-2376↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20027)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20037): Process ended prematurely: osmo-stp_10.42.42.5(pid=20037) [trial-2376↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20037)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20047): Process ended prematurely: osmo-stp_10.42.42.5(pid=20047) [trial-2376↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20047)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=20068): Process ended prematurely: osmo-stp_10.42.42.5(pid=20068) [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20068)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20080): Process ended prematurely: osmo-stp_10.42.42.5(pid=20080) [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=20098): Process ended prematurely: osmo-stp_10.42.42.5(pid=20098) [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20098)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20108): Process ended prematurely: osmo-stp_10.42.42.5(pid=20108) [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20108)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20118): Process ended prematurely: osmo-stp_10.42.42.5(pid=20118) [trial-2376↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20118)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20135): Process ended prematurely: osmo-stp_10.42.42.5(pid=20135) [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20135)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20147): Process ended prematurely: osmo-stp_10.42.42.5(pid=20147) [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20147)] FAIL: iperf3m4.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=20165): Process ended prematurely: osmo-stp_10.42.42.5(pid=20165) [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20165)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20175): Process ended prematurely: osmo-stp_10.42.42.5(pid=20175) [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20175)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20185): Process ended prematurely: osmo-stp_10.42.42.5(pid=20185) [trial-2376↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20185)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20198): Process ended prematurely: osmo-stp_10.42.42.5(pid=20198) [trial-2376↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20198)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20211): Process ended prematurely: osmo-stp_10.42.42.5(pid=20211) [trial-2376↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20211)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20219): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20219) [trial-2376↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20219)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=20229): Process ended prematurely: osmo-stp_10.42.42.5(pid=20229) [trial-2376↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20229)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20243): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20243) [trial-2376↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20243)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=20253): Process ended prematurely: osmo-stp_10.42.42.5(pid=20253) [trial-2376↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20253)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20267): Process ended prematurely: osmo-stp_10.42.42.5(pid=20267) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20278): Process ended prematurely: osmo-stp_10.42.42.5(pid=20278) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20278)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20292): Process ended prematurely: osmo-stp_10.42.42.5(pid=20292) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20292)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20303): Process ended prematurely: osmo-stp_10.42.42.5(pid=20303) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20303)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20317): Process ended prematurely: osmo-stp_10.42.42.5(pid=20317) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20317)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20328): Process ended prematurely: osmo-stp_10.42.42.5(pid=20328) [trial-2376↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20328)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20343): Process ended prematurely: osmo-stp_10.42.42.5(pid=20343) [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20343)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20355): Process ended prematurely: osmo-stp_10.42.42.5(pid=20355) [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20355)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20370): Process ended prematurely: osmo-stp_10.42.42.5(pid=20370) [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20370)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20383): Process ended prematurely: osmo-stp_10.42.42.5(pid=20383) [trial-2376↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20383)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20399): Process ended prematurely: osmo-stp_10.42.42.5(pid=20399) [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20399)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20410): Process ended prematurely: osmo-stp_10.42.42.5(pid=20410) [trial-2376↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20410)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20424): Process ended prematurely: osmo-stp_10.42.42.5(pid=20424) [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20424)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20438): Process ended prematurely: osmo-stp_10.42.42.5(pid=20438) [trial-2376↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20438)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20452): Process ended prematurely: osmo-stp_10.42.42.5(pid=20452) [trial-2376↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20452)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20463): Process ended prematurely: osmo-stp_10.42.42.5(pid=20463) [trial-2376↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20463)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=20481): Process ended prematurely: osmo-stp_10.42.42.5(pid=20481) [trial-2376↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20481)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20494): Process ended prematurely: osmo-stp_10.42.42.5(pid=20494) [trial-2376↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20494)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=20512): Process ended prematurely: osmo-stp_10.42.42.5(pid=20512) [trial-2376↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20512)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20522): Process ended prematurely: osmo-stp_10.42.42.5(pid=20522) [trial-2376↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20522)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20532): Process ended prematurely: osmo-stp_10.42.42.5(pid=20532) [trial-2376↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20532)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20550): Process ended prematurely: osmo-stp_10.42.42.5(pid=20550) [trial-2376↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20550)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20562): Process ended prematurely: osmo-stp_10.42.42.5(pid=20562) [trial-2376↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20562)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=20580): Process ended prematurely: osmo-stp_10.42.42.5(pid=20580) [trial-2376↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20580)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20590): Process ended prematurely: osmo-stp_10.42.42.5(pid=20590) [trial-2376↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20600): Process ended prematurely: osmo-stp_10.42.42.5(pid=20600) [trial-2376↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20600)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=20617): Process ended prematurely: osmo-stp_10.42.42.5(pid=20617) [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20617)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20629): Process ended prematurely: osmo-stp_10.42.42.5(pid=20629) [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20629)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=20647): Process ended prematurely: osmo-stp_10.42.42.5(pid=20647) [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20647)] FAIL: ping.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20929): Process ended prematurely: osmo-stp_10.42.42.5(pid=20929) [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20929)] FAIL: ping_idle_ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=20939): Process ended prematurely: osmo-stp_10.42.42.5(pid=20939) [trial-2376↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20939)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20957): Process ended prematurely: osmo-stp_10.42.42.5(pid=20957) [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20957)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20970): Process ended prematurely: osmo-stp_10.42.42.5(pid=20970) [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20970)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=20988): Process ended prematurely: osmo-stp_10.42.42.5(pid=20988) [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20988)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20998): Process ended prematurely: osmo-stp_10.42.42.5(pid=20998) [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20998)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21008): Process ended prematurely: osmo-stp_10.42.42.5(pid=21008) [trial-2376↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21008)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21022): Process ended prematurely: osmo-stp_10.42.42.5(pid=21022) [trial-2376↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21022)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21036): Process ended prematurely: osmo-stp_10.42.42.5(pid=21036) [trial-2376↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21036)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21048) [trial-2376↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21048)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=21058): Process ended prematurely: osmo-stp_10.42.42.5(pid=21058) [trial-2376↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21058)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=21067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21067) [trial-2376↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21067)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21077): Process ended prematurely: osmo-stp_10.42.42.5(pid=21077) [trial-2376↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21077)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21091): Process ended prematurely: osmo-stp_10.42.42.5(pid=21091) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21091)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21102): Process ended prematurely: osmo-stp_10.42.42.5(pid=21102) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21102)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21116): Process ended prematurely: osmo-stp_10.42.42.5(pid=21116) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21116)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21127): Process ended prematurely: osmo-stp_10.42.42.5(pid=21127) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21127)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21141): Process ended prematurely: osmo-stp_10.42.42.5(pid=21141) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21152): Process ended prematurely: osmo-stp_10.42.42.5(pid=21152) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21152)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21167): Process ended prematurely: osmo-stp_10.42.42.5(pid=21167) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21167)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21178): Process ended prematurely: osmo-stp_10.42.42.5(pid=21178) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21178)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21192): Process ended prematurely: osmo-stp_10.42.42.5(pid=21192) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21192)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21203): Process ended prematurely: osmo-stp_10.42.42.5(pid=21203) [trial-2376↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21203)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21217): Process ended prematurely: osmo-stp_10.42.42.5(pid=21217) [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21217)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21229): Process ended prematurely: osmo-stp_10.42.42.5(pid=21229) [trial-2376↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21229)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21243): Process ended prematurely: osmo-stp_10.42.42.5(pid=21243) [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21243)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21254): Process ended prematurely: osmo-stp_10.42.42.5(pid=21254) [trial-2376↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21254)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21268): Process ended prematurely: osmo-stp_10.42.42.5(pid=21268) [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21268)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21279): Process ended prematurely: osmo-stp_10.42.42.5(pid=21279) [trial-2376↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21279)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21293): Process ended prematurely: osmo-stp_10.42.42.5(pid=21293) [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21293)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21304): Process ended prematurely: osmo-stp_10.42.42.5(pid=21304) [trial-2376↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21304)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21318): Process ended prematurely: osmo-stp_10.42.42.5(pid=21318) [trial-2376↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21318)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21330): Process ended prematurely: osmo-stp_10.42.42.5(pid=21330) [trial-2376↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21330)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21349): Process ended prematurely: osmo-stp_10.42.42.5(pid=21349) [trial-2376↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21349)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=21361): Process ended prematurely: osmo-stp_10.42.42.5(pid=21361) [trial-2376↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21361)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=21379): Process ended prematurely: osmo-stp_10.42.42.5(pid=21379) [trial-2376↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21379)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21389): Process ended prematurely: osmo-stp_10.42.42.5(pid=21389) [trial-2376↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21389)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21409): Process ended prematurely: osmo-stp_10.42.42.5(pid=21409) [trial-2376↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21409)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=21779): Process ended prematurely: osmo-stp_10.42.42.5(pid=21779) [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21779)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21967): Process ended prematurely: osmo-stp_10.42.42.5(pid=21967) [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21967)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=21985): Process ended prematurely: osmo-stp_10.42.42.5(pid=21985) [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21985)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21995): Process ended prematurely: osmo-stp_10.42.42.5(pid=21995) [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21995)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22005): Process ended prematurely: osmo-stp_10.42.42.5(pid=22005) [trial-2376↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22005)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=22022): Process ended prematurely: osmo-stp_10.42.42.5(pid=22022) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22022)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22034): Process ended prematurely: osmo-stp_10.42.42.5(pid=22034) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22034)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=22052): Process ended prematurely: osmo-stp_10.42.42.5(pid=22052) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22052)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=22062): Process ended prematurely: osmo-stp_10.42.42.5(pid=22062) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22062)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22072): Process ended prematurely: osmo-stp_10.42.42.5(pid=22072) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22072)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22091): Process ended prematurely: osmo-stp_10.42.42.5(pid=22091) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22091)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22103): Process ended prematurely: osmo-stp_10.42.42.5(pid=22103) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22103)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=22122): Process ended prematurely: osmo-stp_10.42.42.5(pid=22122) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22122)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22133): Process ended prematurely: osmo-stp_10.42.42.5(pid=22133) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22133)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22143): Process ended prematurely: osmo-stp_10.42.42.5(pid=22143) [trial-2376↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22143)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=22160): Process ended prematurely: osmo-stp_10.42.42.5(pid=22160) [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22160)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22172): Process ended prematurely: osmo-stp_10.42.42.5(pid=22172) [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22172)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=22191): Process ended prematurely: osmo-stp_10.42.42.5(pid=22191) [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22191)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22201): Process ended prematurely: osmo-stp_10.42.42.5(pid=22201) [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22201)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22211): Process ended prematurely: osmo-stp_10.42.42.5(pid=22211) [trial-2376↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22211)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22224): Process ended prematurely: osmo-stp_10.42.42.5(pid=22224) [trial-2376↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22224)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22238): Process ended prematurely: osmo-stp_10.42.42.5(pid=22238) [trial-2376↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22238)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=22246): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22246) [trial-2376↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22246)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22258): Process ended prematurely: osmo-stp_10.42.42.5(pid=22258) [trial-2376↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22258)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=22267): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22267) [trial-2376↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22267)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22280): Process ended prematurely: osmo-stp_10.42.42.5(pid=22280) [trial-2376↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22280)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22294): Process ended prematurely: osmo-stp_10.42.42.5(pid=22294) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22294)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22305): Process ended prematurely: osmo-stp_10.42.42.5(pid=22305) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22305)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22319): Process ended prematurely: osmo-stp_10.42.42.5(pid=22319) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22319)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22330): Process ended prematurely: osmo-stp_10.42.42.5(pid=22330) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22330)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22344): Process ended prematurely: osmo-stp_10.42.42.5(pid=22344) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22344)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22355): Process ended prematurely: osmo-stp_10.42.42.5(pid=22355) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22355)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22370): Process ended prematurely: osmo-stp_10.42.42.5(pid=22370) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22370)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22381): Process ended prematurely: osmo-stp_10.42.42.5(pid=22381) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22381)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22396): Process ended prematurely: osmo-stp_10.42.42.5(pid=22396) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22396)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22407): Process ended prematurely: osmo-stp_10.42.42.5(pid=22407) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22407)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22422): Process ended prematurely: osmo-stp_10.42.42.5(pid=22422) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22422)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22433): Process ended prematurely: osmo-stp_10.42.42.5(pid=22433) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22433)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22447): Process ended prematurely: osmo-stp_10.42.42.5(pid=22447) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22447)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22458): Process ended prematurely: osmo-stp_10.42.42.5(pid=22458) [trial-2376↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22458)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22473): Process ended prematurely: osmo-stp_10.42.42.5(pid=22473) [trial-2376↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22473)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22484): Process ended prematurely: osmo-stp_10.42.42.5(pid=22484) [trial-2376↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22484)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22502): Process ended prematurely: osmo-stp_10.42.42.5(pid=22502) [trial-2376↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22502)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=22786): Process ended prematurely: osmo-stp_10.42.42.5(pid=22786) [trial-2376↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22786)] FAIL: iperf3m4.py (11.9 sec) Error: osmo-stp_10.42.42.5(pid=22804): Process ended prematurely: osmo-stp_10.42.42.5(pid=22804) [trial-2376↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22804)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22814): Process ended prematurely: osmo-stp_10.42.42.5(pid=22814) [trial-2376↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22814)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22824): Process ended prematurely: osmo-stp_10.42.42.5(pid=22824) [trial-2376↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22824)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22842): Process ended prematurely: osmo-stp_10.42.42.5(pid=22842) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22842)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22854): Process ended prematurely: osmo-stp_10.42.42.5(pid=22854) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22854)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=22874): Process ended prematurely: osmo-stp_10.42.42.5(pid=22874) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22874)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22885): Process ended prematurely: osmo-stp_10.42.42.5(pid=22885) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22885)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22898): Process ended prematurely: osmo-stp_10.42.42.5(pid=22898) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22898)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=22916): Process ended prematurely: osmo-stp_10.42.42.5(pid=22916) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22916)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22928): Process ended prematurely: osmo-stp_10.42.42.5(pid=22928) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22928)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=22946): Process ended prematurely: osmo-stp_10.42.42.5(pid=22946) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22946)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22956): Process ended prematurely: osmo-stp_10.42.42.5(pid=22956) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22956)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22966): Process ended prematurely: osmo-stp_10.42.42.5(pid=22966) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22966)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=22983): Process ended prematurely: osmo-stp_10.42.42.5(pid=22983) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22983)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22995): Process ended prematurely: osmo-stp_10.42.42.5(pid=22995) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22995)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=23013): Process ended prematurely: osmo-stp_10.42.42.5(pid=23013) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23013)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23023): Process ended prematurely: osmo-stp_10.42.42.5(pid=23023) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23023)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23033): Process ended prematurely: osmo-stp_10.42.42.5(pid=23033) [trial-2376↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23033)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23048): Process ended prematurely: osmo-stp_10.42.42.5(pid=23048) [trial-2376↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23048)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23061): Process ended prematurely: osmo-stp_10.42.42.5(pid=23061) [trial-2376↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23061)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23069): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23069) [trial-2376↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23069)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=23079): Process ended prematurely: osmo-stp_10.42.42.5(pid=23079) [trial-2376↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23079)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=23088): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23088) [trial-2376↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23088)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23098): Process ended prematurely: osmo-stp_10.42.42.5(pid=23098) [trial-2376↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23098)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23112): Process ended prematurely: osmo-stp_10.42.42.5(pid=23112) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23112)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23123): Process ended prematurely: osmo-stp_10.42.42.5(pid=23123) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23123)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23137): Process ended prematurely: osmo-stp_10.42.42.5(pid=23137) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23137)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23148): Process ended prematurely: osmo-stp_10.42.42.5(pid=23148) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23148)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23162): Process ended prematurely: osmo-stp_10.42.42.5(pid=23162) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23162)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23173): Process ended prematurely: osmo-stp_10.42.42.5(pid=23173) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23173)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23187): Process ended prematurely: osmo-stp_10.42.42.5(pid=23187) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23187)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23198): Process ended prematurely: osmo-stp_10.42.42.5(pid=23198) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23198)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23212): Process ended prematurely: osmo-stp_10.42.42.5(pid=23212) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23212)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23223): Process ended prematurely: osmo-stp_10.42.42.5(pid=23223) [trial-2376↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23223)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23238): Process ended prematurely: osmo-stp_10.42.42.5(pid=23238) [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23238)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23252): Process ended prematurely: osmo-stp_10.42.42.5(pid=23252) [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23252)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23266): Process ended prematurely: osmo-stp_10.42.42.5(pid=23266) [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23266)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23277): Process ended prematurely: osmo-stp_10.42.42.5(pid=23277) [trial-2376↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23277)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23294): Process ended prematurely: osmo-stp_10.42.42.5(pid=23294) [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23294)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23305): Process ended prematurely: osmo-stp_10.42.42.5(pid=23305) [trial-2376↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23305)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23319): Process ended prematurely: osmo-stp_10.42.42.5(pid=23319) [trial-2376↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23319)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23330): Process ended prematurely: osmo-stp_10.42.42.5(pid=23330) [trial-2376↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23330)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=23348): Process ended prematurely: osmo-stp_10.42.42.5(pid=23348) [trial-2376↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23348)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23360): Process ended prematurely: osmo-stp_10.42.42.5(pid=23360) [trial-2376↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23360)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23378): Process ended prematurely: osmo-stp_10.42.42.5(pid=23378) [trial-2376↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23378)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23392): Process ended prematurely: osmo-stp_10.42.42.5(pid=23392) [trial-2376↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23392)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23402): Process ended prematurely: osmo-stp_10.42.42.5(pid=23402) [trial-2376↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23402)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=23420): Process ended prematurely: osmo-stp_10.42.42.5(pid=23420) [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23420)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=23432): Process ended prematurely: osmo-stp_10.42.42.5(pid=23432) [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23432)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23453): Process ended prematurely: osmo-stp_10.42.42.5(pid=23453) [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23453)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23463): Process ended prematurely: osmo-stp_10.42.42.5(pid=23463) [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23463)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23473): Process ended prematurely: osmo-stp_10.42.42.5(pid=23473) [trial-2376↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23473)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23491): Process ended prematurely: osmo-stp_10.42.42.5(pid=23491) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23491)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23503): Process ended prematurely: osmo-stp_10.42.42.5(pid=23503) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23503)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=23521): Process ended prematurely: osmo-stp_10.42.42.5(pid=23521) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23521)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23531): Process ended prematurely: osmo-stp_10.42.42.5(pid=23531) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23531)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23541): Process ended prematurely: osmo-stp_10.42.42.5(pid=23541) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23541)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23558): Process ended prematurely: osmo-stp_10.42.42.5(pid=23558) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23558)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23570): Process ended prematurely: osmo-stp_10.42.42.5(pid=23570) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23570)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=23588): Process ended prematurely: osmo-stp_10.42.42.5(pid=23588) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23588)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23599): Process ended prematurely: osmo-stp_10.42.42.5(pid=23599) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23599)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23613): Process ended prematurely: osmo-stp_10.42.42.5(pid=23613) [trial-2376↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23613)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23630): Process ended prematurely: osmo-stp_10.42.42.5(pid=23630) [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23630)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23642): Process ended prematurely: osmo-stp_10.42.42.5(pid=23642) [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23642)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=23660): Process ended prematurely: osmo-stp_10.42.42.5(pid=23660) [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23660)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23670): Process ended prematurely: osmo-stp_10.42.42.5(pid=23670) [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23670)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23680): Process ended prematurely: osmo-stp_10.42.42.5(pid=23680) [trial-2376↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23680)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23695): Process ended prematurely: osmo-stp_10.42.42.5(pid=23695) [trial-2376↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23695)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23709): Process ended prematurely: osmo-stp_10.42.42.5(pid=23709) [trial-2376↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23709)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23717): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23717) [trial-2376↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23717)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23727): Process ended prematurely: osmo-stp_10.42.42.5(pid=23727) [trial-2376↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23727)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23736): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23736) [trial-2376↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23736)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23746): Process ended prematurely: osmo-stp_10.42.42.5(pid=23746) [trial-2376↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23746)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23760): Process ended prematurely: osmo-stp_10.42.42.5(pid=23760) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23760)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23771): Process ended prematurely: osmo-stp_10.42.42.5(pid=23771) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23771)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23785): Process ended prematurely: osmo-stp_10.42.42.5(pid=23785) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23785)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23796): Process ended prematurely: osmo-stp_10.42.42.5(pid=23796) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23796)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23810): Process ended prematurely: osmo-stp_10.42.42.5(pid=23810) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23810)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23821): Process ended prematurely: osmo-stp_10.42.42.5(pid=23821) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23821)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23884): Process ended prematurely: osmo-stp_10.42.42.5(pid=23884) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23884)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24117): Process ended prematurely: osmo-stp_10.42.42.5(pid=24117) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24117)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24133): Process ended prematurely: osmo-stp_10.42.42.5(pid=24133) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24133)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24144): Process ended prematurely: osmo-stp_10.42.42.5(pid=24144) [trial-2376↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24144)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24158): Process ended prematurely: osmo-stp_10.42.42.5(pid=24158) [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24158)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24169): Process ended prematurely: osmo-stp_10.42.42.5(pid=24169) [trial-2376↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24169)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24184): Process ended prematurely: osmo-stp_10.42.42.5(pid=24184) [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24184)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24195): Process ended prematurely: osmo-stp_10.42.42.5(pid=24195) [trial-2376↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24195)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24210): Process ended prematurely: osmo-stp_10.42.42.5(pid=24210) [trial-2376↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24210)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24221): Process ended prematurely: osmo-stp_10.42.42.5(pid=24221) [trial-2376↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24221)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=24244): Process ended prematurely: osmo-stp_10.42.42.5(pid=24244) [trial-2376↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24244)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=24256): Process ended prematurely: osmo-stp_10.42.42.5(pid=24256) [trial-2376↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24256)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=24274): Process ended prematurely: osmo-stp_10.42.42.5(pid=24274) [trial-2376↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24274)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24284): Process ended prematurely: osmo-stp_10.42.42.5(pid=24284) [trial-2376↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24284)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24294): Process ended prematurely: osmo-stp_10.42.42.5(pid=24294) [trial-2376↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24294)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24311): Process ended prematurely: osmo-stp_10.42.42.5(pid=24311) [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24311)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24323): Process ended prematurely: osmo-stp_10.42.42.5(pid=24323) [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24323)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=24341): Process ended prematurely: osmo-stp_10.42.42.5(pid=24341) [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24341)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24351): Process ended prematurely: osmo-stp_10.42.42.5(pid=24351) [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24351)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24361): Process ended prematurely: osmo-stp_10.42.42.5(pid=24361) [trial-2376↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24361)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=24378): Process ended prematurely: osmo-stp_10.42.42.5(pid=24378) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24378)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24390): Process ended prematurely: osmo-stp_10.42.42.5(pid=24390) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24390)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=24410): Process ended prematurely: osmo-stp_10.42.42.5(pid=24410) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24410)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24420): Process ended prematurely: osmo-stp_10.42.42.5(pid=24420) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24420)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24430): Process ended prematurely: osmo-stp_10.42.42.5(pid=24430) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24430)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=24447): Process ended prematurely: osmo-stp_10.42.42.5(pid=24447) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24447)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24459): Process ended prematurely: osmo-stp_10.42.42.5(pid=24459) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24459)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=24477): Process ended prematurely: osmo-stp_10.42.42.5(pid=24477) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24477)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24487): Process ended prematurely: osmo-stp_10.42.42.5(pid=24487) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24487)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24497): Process ended prematurely: osmo-stp_10.42.42.5(pid=24497) [trial-2376↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24497)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24510): Process ended prematurely: osmo-stp_10.42.42.5(pid=24510) [trial-2376↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24510)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24524): Process ended prematurely: osmo-stp_10.42.42.5(pid=24524) [trial-2376↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24524)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=24533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24533) [trial-2376↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24533)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24543): Process ended prematurely: osmo-stp_10.42.42.5(pid=24543) [trial-2376↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24543)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=24552): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24552) [trial-2376↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24552)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24563): Process ended prematurely: osmo-stp_10.42.42.5(pid=24563) [trial-2376↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24563)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24580): Process ended prematurely: osmo-stp_10.42.42.5(pid=24580) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24580)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24591): Process ended prematurely: osmo-stp_10.42.42.5(pid=24591) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24591)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24607): Process ended prematurely: osmo-stp_10.42.42.5(pid=24607) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24607)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24618): Process ended prematurely: osmo-stp_10.42.42.5(pid=24618) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24618)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24632): Process ended prematurely: osmo-stp_10.42.42.5(pid=24632) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24632)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24643): Process ended prematurely: osmo-stp_10.42.42.5(pid=24643) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24643)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24657): Process ended prematurely: osmo-stp_10.42.42.5(pid=24657) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24657)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24668): Process ended prematurely: osmo-stp_10.42.42.5(pid=24668) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24668)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24682): Process ended prematurely: osmo-stp_10.42.42.5(pid=24682) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24693): Process ended prematurely: osmo-stp_10.42.42.5(pid=24693) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24707): Process ended prematurely: osmo-stp_10.42.42.5(pid=24707) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24707)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24718): Process ended prematurely: osmo-stp_10.42.42.5(pid=24718) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24718)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24732): Process ended prematurely: osmo-stp_10.42.42.5(pid=24732) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24732)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24743): Process ended prematurely: osmo-stp_10.42.42.5(pid=24743) [trial-2376↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24743)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24758): Process ended prematurely: osmo-stp_10.42.42.5(pid=24758) [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24758)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24771): Process ended prematurely: osmo-stp_10.42.42.5(pid=24771) [trial-2376↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24771)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24789): Process ended prematurely: osmo-stp_10.42.42.5(pid=24789) [trial-2376↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24789)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=24802): Process ended prematurely: osmo-stp_10.42.42.5(pid=24802) [trial-2376↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24802)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=24820): Process ended prematurely: osmo-stp_10.42.42.5(pid=24820) [trial-2376↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24820)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24830): Process ended prematurely: osmo-stp_10.42.42.5(pid=24830) [trial-2376↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24830)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24840): Process ended prematurely: osmo-stp_10.42.42.5(pid=24840) [trial-2376↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24840)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=24857): Process ended prematurely: osmo-stp_10.42.42.5(pid=24857) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24857)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=24869): Process ended prematurely: osmo-stp_10.42.42.5(pid=24869) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24869)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=24889): Process ended prematurely: osmo-stp_10.42.42.5(pid=24889) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24889)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24899): Process ended prematurely: osmo-stp_10.42.42.5(pid=24899) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24899)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24909): Process ended prematurely: osmo-stp_10.42.42.5(pid=24909) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24909)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24926): Process ended prematurely: osmo-stp_10.42.42.5(pid=24926) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24926)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24941): Process ended prematurely: osmo-stp_10.42.42.5(pid=24941) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24941)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=24964): Process ended prematurely: osmo-stp_10.42.42.5(pid=24964) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24964)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24975): Process ended prematurely: osmo-stp_10.42.42.5(pid=24975) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24975)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24985): Process ended prematurely: osmo-stp_10.42.42.5(pid=24985) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24985)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25002): Process ended prematurely: osmo-stp_10.42.42.5(pid=25002) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25002)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=25014): Process ended prematurely: osmo-stp_10.42.42.5(pid=25014) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25014)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=25032): Process ended prematurely: osmo-stp_10.42.42.5(pid=25032) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25032)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25043): Process ended prematurely: osmo-stp_10.42.42.5(pid=25043) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25043)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25053): Process ended prematurely: osmo-stp_10.42.42.5(pid=25053) [trial-2376↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25053)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25067): Process ended prematurely: osmo-stp_10.42.42.5(pid=25067) [trial-2376↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25067)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25081): Process ended prematurely: osmo-stp_10.42.42.5(pid=25081) [trial-2376↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25081)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=25090): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25090) [trial-2376↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25090)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25102): Process ended prematurely: osmo-stp_10.42.42.5(pid=25102) [trial-2376↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25102)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=25111): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25111) [trial-2376↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25111)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=25121): Process ended prematurely: osmo-stp_10.42.42.5(pid=25121) [trial-2376↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25121)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25135): Process ended prematurely: osmo-stp_10.42.42.5(pid=25135) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25135)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25146): Process ended prematurely: osmo-stp_10.42.42.5(pid=25146) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25146)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=25160): Process ended prematurely: osmo-stp_10.42.42.5(pid=25160) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25160)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=25444): Process ended prematurely: osmo-stp_10.42.42.5(pid=25444) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25444)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=25458): Process ended prematurely: osmo-stp_10.42.42.5(pid=25458) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25458)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25470): Process ended prematurely: osmo-stp_10.42.42.5(pid=25470) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25470)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25484): Process ended prematurely: osmo-stp_10.42.42.5(pid=25484) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25484)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25495): Process ended prematurely: osmo-stp_10.42.42.5(pid=25495) [trial-2376↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25495)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25509): Process ended prematurely: osmo-stp_10.42.42.5(pid=25509) [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25509)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25520): Process ended prematurely: osmo-stp_10.42.42.5(pid=25520) [trial-2376↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25520)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25534): Process ended prematurely: osmo-stp_10.42.42.5(pid=25534) [trial-2376↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25534)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25545): Process ended prematurely: osmo-stp_10.42.42.5(pid=25545) [trial-2376↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25545)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=25566): Process ended prematurely: osmo-stp_10.42.42.5(pid=25566) [trial-2376↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25566)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=25578): Process ended prematurely: osmo-stp_10.42.42.5(pid=25578) [trial-2376↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=25596): Process ended prematurely: osmo-stp_10.42.42.5(pid=25596) [trial-2376↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25596)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25606): Process ended prematurely: osmo-stp_10.42.42.5(pid=25606) [trial-2376↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25606)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25616): Process ended prematurely: osmo-stp_10.42.42.5(pid=25616) [trial-2376↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25616)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=25633): Process ended prematurely: osmo-stp_10.42.42.5(pid=25633) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25633)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=25645): Process ended prematurely: osmo-stp_10.42.42.5(pid=25645) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25645)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=25663): Process ended prematurely: osmo-stp_10.42.42.5(pid=25663) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25663)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25673): Process ended prematurely: osmo-stp_10.42.42.5(pid=25673) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25673)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25683): Process ended prematurely: osmo-stp_10.42.42.5(pid=25683) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25683)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=25707): Process ended prematurely: osmo-stp_10.42.42.5(pid=25707) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25707)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=25719): Process ended prematurely: osmo-stp_10.42.42.5(pid=25719) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25719)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=25737): Process ended prematurely: osmo-stp_10.42.42.5(pid=25737) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25737)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25747): Process ended prematurely: osmo-stp_10.42.42.5(pid=25747) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25747)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25757): Process ended prematurely: osmo-stp_10.42.42.5(pid=25757) [trial-2376↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25757)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25770): Process ended prematurely: osmo-stp_10.42.42.5(pid=25770) [trial-2376↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25770)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25784): Process ended prematurely: osmo-stp_10.42.42.5(pid=25784) [trial-2376↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25784)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=25794): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25794) [trial-2376↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25794)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25805): Process ended prematurely: osmo-stp_10.42.42.5(pid=25805) [trial-2376↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25805)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25819): Process ended prematurely: osmo-stp_10.42.42.5(pid=25819) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25819)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25830): Process ended prematurely: osmo-stp_10.42.42.5(pid=25830) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25830)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25845): Process ended prematurely: osmo-stp_10.42.42.5(pid=25845) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25845)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25856): Process ended prematurely: osmo-stp_10.42.42.5(pid=25856) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25856)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25870): Process ended prematurely: osmo-stp_10.42.42.5(pid=25870) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25870)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25881): Process ended prematurely: osmo-stp_10.42.42.5(pid=25881) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25881)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25895): Process ended prematurely: osmo-stp_10.42.42.5(pid=25895) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25895)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25906): Process ended prematurely: osmo-stp_10.42.42.5(pid=25906) [trial-2376↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25906)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25923): Process ended prematurely: osmo-stp_10.42.42.5(pid=25923) [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25923)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25934): Process ended prematurely: osmo-stp_10.42.42.5(pid=25934) [trial-2376↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25934)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=25949): Process ended prematurely: osmo-stp_10.42.42.5(pid=25949) [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25949)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=25960): Process ended prematurely: osmo-stp_10.42.42.5(pid=25960) [trial-2376↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25960)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25974): Process ended prematurely: osmo-stp_10.42.42.5(pid=25974) [trial-2376↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25974)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25985): Process ended prematurely: osmo-stp_10.42.42.5(pid=25985) [trial-2376↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26003): Process ended prematurely: osmo-stp_10.42.42.5(pid=26003) [trial-2376↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26003)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26015): Process ended prematurely: osmo-stp_10.42.42.5(pid=26015) [trial-2376↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26015)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=26033): Process ended prematurely: osmo-stp_10.42.42.5(pid=26033) [trial-2376↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26033)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26043): Process ended prematurely: osmo-stp_10.42.42.5(pid=26043) [trial-2376↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26043)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26053): Process ended prematurely: osmo-stp_10.42.42.5(pid=26053) [trial-2376↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26053)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=26072): Process ended prematurely: osmo-stp_10.42.42.5(pid=26072) [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26072)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26084): Process ended prematurely: osmo-stp_10.42.42.5(pid=26084) [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26084)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=26104): Process ended prematurely: osmo-stp_10.42.42.5(pid=26104) [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26104)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26114): Process ended prematurely: osmo-stp_10.42.42.5(pid=26114) [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26114)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26124): Process ended prematurely: osmo-stp_10.42.42.5(pid=26124) [trial-2376↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26124)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=26141): Process ended prematurely: osmo-stp_10.42.42.5(pid=26141) [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26141)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=26153): Process ended prematurely: osmo-stp_10.42.42.5(pid=26153) [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26153)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=26172): Process ended prematurely: osmo-stp_10.42.42.5(pid=26172) [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26172)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26182): Process ended prematurely: osmo-stp_10.42.42.5(pid=26182) [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26182)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26192): Process ended prematurely: osmo-stp_10.42.42.5(pid=26192) [trial-2376↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26192)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26210): Process ended prematurely: osmo-stp_10.42.42.5(pid=26210) [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26210)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=26222): Process ended prematurely: osmo-stp_10.42.42.5(pid=26222) [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26222)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=26240): Process ended prematurely: osmo-stp_10.42.42.5(pid=26240) [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26240)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26250): Process ended prematurely: osmo-stp_10.42.42.5(pid=26250) [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26250)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26263): Process ended prematurely: osmo-stp_10.42.42.5(pid=26263) [trial-2376↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26263)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26276): Process ended prematurely: osmo-stp_10.42.42.5(pid=26276) [trial-2376↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26276)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=26292): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26292) [trial-2376↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26292)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=26294): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26294) [trial-2376↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26294)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=26296): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26296) [trial-2376↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26296)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=26298): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26298) [trial-2376↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26298)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.5 sec) Error: osmo-hlr_10.42.42.2(pid=26308): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26308) [trial-2376↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26308)] FAIL: esme_connect_policy_closed.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=26319): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26319) [trial-2376↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26319)] FAIL: esme_ms_sms_storeforward.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26331): Process ended prematurely: osmo-stp_10.42.42.5(pid=26331) [trial-2376↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26331)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26342): Process ended prematurely: osmo-stp_10.42.42.5(pid=26342) [trial-2376↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26342)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26356): Process ended prematurely: osmo-stp_10.42.42.5(pid=26356) [trial-2376↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26356)] FAIL: register_a5_0_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26367): Process ended prematurely: osmo-stp_10.42.42.5(pid=26367) [trial-2376↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26367)] FAIL: register_a5_1_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26378): Process ended prematurely: osmo-stp_10.42.42.5(pid=26378) [trial-2376↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26378)] FAIL: register_a5_3_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26389): Process ended prematurely: osmo-stp_10.42.42.5(pid=26389) [trial-2376↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26389)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.1 sec) Error: srsepc(pid=26409): Process ended prematurely: srsepc(pid=26409) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26409)] FAIL: iperf3_bidir.py (18.8 sec) Error: srsepc(pid=26425): Process ended prematurely: srsepc(pid=26425) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26425)] FAIL: iperf3_dl.py (18.6 sec) Error: srsepc(pid=26441): Process ended prematurely: srsepc(pid=26441) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26441)] FAIL: iperf3_ul.py (18.8 sec) Error: srsepc(pid=26460): Process ended prematurely: srsepc(pid=26460) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26460)] FAIL: ping.py (18.6 sec) Error: srsepc(pid=26476): Process ended prematurely: srsepc(pid=26476) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26476)] FAIL: rrc_idle_mo_ping.py (19.4 sec) Error: srsepc(pid=26764): Process ended prematurely: srsepc(pid=26764) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26764)] FAIL: rrc_idle_mt_ping.py (18.2 sec) Error: srsepc(pid=26785): Process ended prematurely: srsepc(pid=26785) [trial-2376↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26785)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26798): Process ended prematurely: osmo-stp_10.42.42.5(pid=26798) [trial-2376↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26798)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26812): Process ended prematurely: osmo-stp_10.42.42.5(pid=26812) [trial-2376↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26812)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26826): Process ended prematurely: osmo-stp_10.42.42.5(pid=26826) [trial-2376↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26826)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26840): Process ended prematurely: osmo-stp_10.42.42.5(pid=26840) [trial-2376↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26840)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26854): Process ended prematurely: osmo-stp_10.42.42.5(pid=26854) [trial-2376↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26854)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26871): Process ended prematurely: osmo-stp_10.42.42.5(pid=26871) [trial-2376↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=26885): Process ended prematurely: osmo-stp_10.42.42.5(pid=26885) [trial-2376↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26885)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26899): Process ended prematurely: osmo-stp_10.42.42.5(pid=26899) [trial-2376↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26899)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26914): Process ended prematurely: osmo-stp_10.42.42.5(pid=26914) [trial-2376↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26914)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26928): Process ended prematurely: osmo-stp_10.42.42.5(pid=26928) [trial-2376↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26928)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26942): Process ended prematurely: osmo-stp_10.42.42.5(pid=26942) [trial-2376↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26942)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26957): Process ended prematurely: osmo-stp_10.42.42.5(pid=26957) [trial-2376↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26957)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26971): Process ended prematurely: osmo-stp_10.42.42.5(pid=26971) [trial-2376↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26971)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26986): Process ended prematurely: osmo-stp_10.42.42.5(pid=26986) [trial-2376↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26986)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27000): Process ended prematurely: osmo-stp_10.42.42.5(pid=27000) [trial-2376↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27000)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27014): Process ended prematurely: osmo-stp_10.42.42.5(pid=27014) [trial-2376↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27014)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27028): Process ended prematurely: osmo-stp_10.42.42.5(pid=27028) [trial-2376↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27028)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27042): Process ended prematurely: osmo-stp_10.42.42.5(pid=27042) [trial-2376↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27042)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27056): Process ended prematurely: osmo-stp_10.42.42.5(pid=27056) [trial-2376↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27056)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27072): Process ended prematurely: osmo-stp_10.42.42.5(pid=27072) [trial-2376↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27072)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27086): Process ended prematurely: osmo-stp_10.42.42.5(pid=27086) [trial-2376↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27086)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27100): Process ended prematurely: osmo-stp_10.42.42.5(pid=27100) [trial-2376↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27100)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27114): Process ended prematurely: osmo-stp_10.42.42.5(pid=27114) [trial-2376↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27114)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27129): Process ended prematurely: osmo-stp_10.42.42.5(pid=27129) [trial-2376↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27129)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27143): Process ended prematurely: osmo-stp_10.42.42.5(pid=27143) [trial-2376↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27143)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27157): Process ended prematurely: osmo-stp_10.42.42.5(pid=27157) [trial-2376↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27157)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27171): Process ended prematurely: osmo-stp_10.42.42.5(pid=27171) [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27171)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27185): Process ended prematurely: osmo-stp_10.42.42.5(pid=27185) [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27185)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27199): Process ended prematurely: osmo-stp_10.42.42.5(pid=27199) [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27199)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27213): Process ended prematurely: osmo-stp_10.42.42.5(pid=27213) [trial-2376↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27213)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27227): Process ended prematurely: osmo-stp_10.42.42.5(pid=27227) [trial-2376↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27227)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27244): Process ended prematurely: osmo-stp_10.42.42.5(pid=27244) [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27244)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27258): Process ended prematurely: osmo-stp_10.42.42.5(pid=27258) [trial-2376↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27258)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27272): Process ended prematurely: osmo-stp_10.42.42.5(pid=27272) [trial-2376↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27272)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27286): Process ended prematurely: osmo-stp_10.42.42.5(pid=27286) [trial-2376↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27286)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27300): Process ended prematurely: osmo-stp_10.42.42.5(pid=27300) [trial-2376↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27300)] + rm -rf trial-2376/inst + cd trial-2376 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-10 15:36:56 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376-run.tgz run.2022-12-10_15-37-08 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2376-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17660.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6681.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2957.tgz osmo-mgw.build-8947.tgz osmo-msc.build-29271.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30049.tgz osmo-stp.build-9242.tgz osmo-trx.build-4678.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE